Turning "Searching" into "Comparing" — The Effect of Sequence in Talent Selection
This article was automatically translated from the Japanese original. Read the original in Japanese

Even if you hand the same candidates to the same person, the quality of the answer you get back changes depending on how you present the task. Being asked to "find someone good" from a large pool of candidates is a fundamentally different question than being asked "which of these fits this project better" from a narrowed-down handful. The former is the work of "searching"; the latter is the work of "comparing."
We divide our talent selection decisions into two stages: a process that mechanically excludes candidates who are clearly unsuitable, and a process in which people compare the candidates who remain. What this article wants to explore is not the two-stage structure itself, but what the sequence changes — namely, the shape of the question the person is actually facing.
The Work of "Searching" vs. the Work of "Comparing"
"Searching" and "comparing" may both look like tasks where a person evaluates candidates, but they differ entirely in difficulty and precision.
The task of "searching for someone good" from a broad pool inevitably involves structural oversights. The amount of attention a person can give at any one time is limited, so it's impossible to look at many candidates with the same level of scrutiny. Once you speed up the pace of review, candidates who happen to stand out gain an advantage, while candidates who are unassuming but actually fit well can slip out of view entirely. This isn't a matter of the reviewer's competence — it's a structural feature of the act of "searching" itself.
By contrast, the task of "comparing" a small, pre-narrowed set of candidates is different in nature. When there are only a few candidates, you can hold the information about each one in mind and compare them side by side. Differences that are hard to put into words on their own — the mood of a feed, how naturally something aligns with a brand — become clear the moment two candidates are placed next to each other. The act of comparing itself raises the resolution of judgment.
Even the same person with the same perspective will arrive at a different quality of conclusion depending on whether they're being asked to "search" or to "compare."
Stage One — Finishing the Work of "Searching"
What the first stage handles is mechanically excluding combinations that are clearly unsuitable, thereby eliminating the need for a person to ever be in a "searching" situation at all. Against conditions that can be expressed as numbers or attributes — follower count levels, content genre, overlap with the target audience — candidates whose fundamentals simply don't fit are excluded here.
What this stage requires is reproducibility and speed. Given the same conditions, anyone reviewing them should arrive at the same conclusion. If the criteria shift based on a staff member's mood or personal preference on a given day, the narrowing-down loses its meaning. If you think of the first stage's role not as "choosing candidates" but as "creating a state where people never have to search for candidates in the first place," it becomes clear why this stage should be mechanical.
Stage Two — The Work of "Comparing"
The second stage is where people compare the candidates who made it through the first stage. What we're looking at here is what can't be captured in numbers: the mood conveyed by a feed, the atmosphere gathered in the comments section, how naturally it aligns with the world the brand wants to convey.
We believe this is territory where meaning is lost the moment you try to quantify it. The more you break things down into individual metrics, the more you lose sight of the overall sense of fit — how those metrics interact with one another. The moment you turn a feed's atmosphere and a comment section's mood into separate, standalone scores, the impression the two create together disappears. What a skilled eye is looking at is precisely this interplay. And it's only because the pool has been narrowed to a small number that there's room to compare this interplay at all.
A Note on the Word "Excluding"
Up to this point, we've used words like "excluding candidates" and "narrowing down," but there's something we want to clarify to avoid misunderstanding. What gets excluded at the first stage is a combination with that specific project's context — not a judgment on the person's worth.
The same candidate can easily pass through the first stage and reach the comparison stage for a different project. It's entirely possible that this time, the fit with the desired world simply wasn't there, but with a different brand or a different campaign, that same candidate might have been in the comparison pool from the start. What we're always judging is "whether this person and this project fit, this time" — never "how good this person is, in general." Not confusing these two things is, for us, a fundamental premise of the work of selection.
On Looking at Comments and Posts
In the second stage, we actually look at candidates' feeds and comment sections. If this is understood as a process of scoring past post performance or monitoring behavior, that would misrepresent our intent.
The reason we look at comment sections is to grasp how the atmosphere gathered there resonates with the world the brand wants to convey this time. What we're looking at is the atmosphere that has formed around the account — not secretly scoring the behavior of the person posting. We make a point of never forgetting the premise that we're looking in order to understand.
A Counterargument — Isn't This Just Relying on Gut Feeling?
Having read this far, some of you may be thinking, "Isn't the second stage ultimately just relying on gut feeling?" To answer honestly: yes, the judgment made in the second stage is, in fact, a human judgment made by eye, without numerical backing. We have no intention of dressing that up as something else.
However, the instinct at work in the second stage is not the instinct used to "search" for someone from a broad pool. It's the instinct used to "compare" within an already-narrowed set of candidates. This distinction matters a great deal. The instinct used for searching is structurally prone to oversights and remains low in reproducibility. The instinct used for comparing, because the pool is small, makes it easier to apply the same perspective consistently, which raises the precision of judgment. The fact that we're relying on instinct is true either way — but which kind of instinct we rely on is a choice. Splitting the process into two stages is our way of making that choice deliberately.
What's more, the perspectives applied in the second stage aren't a matter of "vaguely good" or "vaguely bad." Fit with brand tone, the mood of a feed, the quality of a comment section — these perspectives can always be put into words. Even if they can't be quantified, they can be verbalized. This stance is what grounds the judgment made at the second stage.
A Practical Takeaway — Are You Having People "Search," or "Compare"?
If there's one thing to take away from this article, it's this checkpoint: examine whether your own selection process has your staff "searching" or "comparing."
The first thing to check is the number of candidates handed to the second stage. Are you leaving feed review to staff using a large, unfiltered list? If you're handing over a number close to the size of the original pool, you're effectively still making people do the "searching" stage themselves.
The second thing to check is how you ask about the reasoning behind decisions. When you ask, "Why did you choose this person?" — can your staff point to the comparison and say, "This one fits better than that one"? Or does the answer stop at a vague "this one just seemed good" about a single candidate in isolation? The former is evidence of genuine comparison; the latter is a sign that narrowing-down was insufficient, and staff are being forced into standalone evaluation — which is really just "searching" by another name.
The third thing to check is the criteria used in the first stage. Are those criteria documented in words, so that even if the person in charge changes, the same group of candidates would still be narrowed down? If the criteria exist only in one specific person's head, dependency on that individual has already begun before candidates even reach the second stage.
We can't offer numerical targets or benchmark figures here, but these three questions should be applicable to any selection process for a checkup.
Closing Thoughts
Even the same person with the same perspective will produce a different quality of judgment depending on whether they're asked to "search" or to "compare." We split the process into two stages not merely for the sake of efficiency, but to ensure that people are only given the kind of work that suits people. We believe that structuring the sequence itself is part of the design of selection.
Next time, we'll share another perspective drawn from our day-to-day work.
We'll deliver further updates via our email newsletter. Please sign up below.