How reliable are the results? Wouldn't respondents lie?

Every survey’s reliability rests on three pillars:

1. Peer definition
   Narrow, well-defined peer groups produce sharper, more meaningful insights.

2. Response quality
   The more respondents you reach (and the more carefully they answer) the stronger the resulting patterns.

3. Anonymity integrity
   Partial, high-level results are only released once at least three responses are collected, ensuring a baseline level of privacy for everyone involved. Final survey peer group size must be 4 minimum and there's no way around this (you cannot manually close a survey under this size)

Salary Confidential's role is to guarantee the integrity of the exchange, not to interpret the results.
We make the peer-to-peer survey possible; the precision of the outcome depends on how carefully you define your question and the people you invite to respond.

What about… liars?

As we designed Salary Confidential, we spent a large amount of time with three important social concerns we needed to address in the platform.

Two are typically voiced from the respondent’s perspective:

• Could recruiters pose as requesters to quietly sound out candidates? (Recruiters are absolutely welcome on the platform, as long as they identify themselves truthfully)
• What if a nosy acquaintance is trying to snoop on my compensation?

The third concern comes from the requester’s side:

• What if someone submits false data on purpose?

If you’ve been reading this FAQ closely, you’ve already seen how we address stealth recruiters and unwanted snooping (tl;dr: Requesters can never be anonymous)

The third concern —- deliberate misrepresentation -— is different.

There’s no purely technical solution to it. We can’t code against psychology, and adding a checkbox that says "I promise to tell the truth" wouldn’t meaningfully improve outcomes. What is possible, however, is to limit the incentives for lying.

Anonymity reduces social incentives for lying

People generally don’t lie at random. They lie for a payoff — social, financial, or psychological.

Survey research consistently shows that people adjust answers to manage how they are perceived by others, a phenomenon often described as social desirability bias. This can include impression management, self-enhancement, or avoiding embarrassment.

In a nameless, secret and anonymous setting, those incentives are largely removed:

• There’s no one to impress.
• There’s no reputation to protect.
• There’s no social standing to gain.

That doesn’t make lying impossible, but it makes it less rewarding.

This is why we’re very transparent about how anonymity works on Salary Confidential. We explain how data is escrowed and how individual responses are blurred in aggregation, not just to reassure respondents, but also to make something clear: there is no upside to distortion.

And if someone is uncomfortable with a request in the first place, the most common response isn’t to fabricate a number: it’s simply not to participate.

Anonymity helps — but survey design matters just as much

In reviewing the research on response accuracy, one point is especially clear:
anonymity improves psychological safety, but it does not guarantee accuracy on its own.

How questions are framed matters.

If a question is ambiguous, emotionally loaded, or forces multiple interpretations into a single answer, respondents may feel conflicted about how to respond — even when they want to be truthful.

That’s why Salary Confidential heavily invests in survey design, not just privacy mechanics.

Based on this literature, we introduced mandatory "fair value" compensation questions. These give respondents a clear, separate way to express what they believe their role should pay, without mixing that judgment into the factual reporting of their current compensation.

If you’d like to dig deeper into why this matters, we explain the reasoning in detail here:
Why we ask for fair value pay in addition to actual compensation numbers

And yet…

Even in anonymous settings, even with thoughtful design, misrepresentation can still occur. Sociological and survey-methods research is very explicit about this: no survey system can promise perfect truthfulness. We are not promising this.

What we can promise is that we’ve thought carefully about:

• incentives,
• psychological comfort,
• question clarity,
• and the social dynamics that influence how people answer.

Salary Confidential doesn’t eliminate human behavior, but it is designed to make accurate participation the most natural and comfortable option available.