When Aptitude Testing Contradicts Everything Else in Your Recruitment Process

Aptitude testing exists for this exact moment, it isn’t necessarily there for the straightforward hiring processes where everything aligns and decision feels easy. It is there for the ones where the data pushes back and how an organisation uses that data reveals far more about their decision making culture than any number of well-designed interview frameworks.

When this happens, I believe most people are likely the feel urge to question the test, it’s accuracy suitability or relevance. The reasoning tends to follow a similar pattern, the candidate has been impressive, the conversations had real substance and that in-person experience should carry more weight than a single, isolated score which can vary depending on circumstance.

And so, the process that has been designed to introduce objectivity to the decision quietly gets managed and the hire get’s made on “gut-feel” or instinct dressed up as better judgement. This pattern is worth examining, it is precisely the scenario that aptitude testing exists for. I’ve been debating this with a client of mine recently and I feel through doing so, I have a much greater appreciation of what these tests can deliver and why.

The instinct to override

Human judgement in recruitment is inconsistent in ways that are well documented and largely invisible to the people exercising it. We warm to candidates who present in a style similar to our own, we over-index on confidence and mistake someone being articulate and polished for being capable. We are influenced by how much we enjoyed the conversation, by first impressions formed long before the formal assessment began and by the social discomfort of reversing a position we have already started to form.

A well-constructed aptitude test removes at least one layer of doubt. It does not care how polished the candidate is. It measures the underlying cognitive capacity, the ability to process information, identify patterns and solve problems. The test tends to predict performance in complex roles more reliably than interview performance alone as it provides an objective data-point.

The score that contradicts five hours of positive impressions is not necessarily wrong. In many cases, it is doing exactly what it is supposed to do.

The senior appointment problem

The place where this tension is most obvious is at the top of an organisation, this is where many leaders trust their gut more than objectivity and ultimately, getting the hire at this level wrong can be the most consequential. Executive and leadership hires carry the highest stakes, they involve the most stakeholders and are subject to the greatest pressure to appoint quickly once you have a preferred candidate.

They are also the appointments where cognitive aptitude matters most. The complexity of decisions at leadership level, the volume of information that needs to be processed, the speed at which environments change, these are conditions that place a genuine premium on raw intellectual capacity. A candidate who presents well but lacks the aptitude to operate at that level will typically be found out, and the cost of that discovery can be significant.

This is why some of the most rigorous organisations apply aptitude testing more stringently at senior level, not less. The social pressure to discount the score is higher, which means the discipline required to take it seriously is greater.

Creating Objectivity

None of this is an argument for treating the aptitude score as the final word and I personally don’t feel you should. A “computer says no” style to using aptitude testing is definitely wrong but discounting what it tells you is equally so. A high score does not guarantee the right hire, and a score that sits below expectation does not automatically disqualify a candidate. The assessment is one input into a process that should include multiple sources of evidence, and context always matters.

What it does argue for is having a clear framework before you find yourself in the room with a contradiction. Organisations that decide in advance how much weight the aptitude measure carries, and under what circumstances it can be overridden, and by whom, make better decisions than those who treat it as a judgement call in the moment. Because judgement calls in the moment are where bias lives.

This is why we create bespoke processes for our clients, we use the data we extract from aptitude testing, Extended DISC and the previous interview rounds to generate a framework that allows for challenge. If we know someone has scored particularly low on numerical reasoning and is more impulsive than detail orientated, we know to probe that with case studies that peel back the layers to explore it.

The question worth asking

When a test result contradicts everything else in your process, the productive question is not “do we trust the test?” It is “what would have to be true for the test to be right, and are we genuinely prepared to explore that?”

If the answer is no, if the decision has already been made and the assessment is being managed around rather than engaged with, then the testing programme is not really informing your recruitment. It is providing the appearance of rigour without the substance of it.

The organisations that get the most value from aptitude testing are the ones that are willing to be told something they did not want to hear, and take it seriously when they are. Now there can be real discomfort in doing this, it is a great skill to be able to ask the questions you know you don’t want to hear the answers to, but it usually gives you the greatest insights.