AmazingHiring - Sourcing Guru Interview: Tom Winter

Sourcing Guru Interview: Tom Winter

Excited to share a very special sourcing guru interview! Tom Winter, the Co-Founder of Devskiller, revealed the secrets of screening, testing and interviewing developers.

How did you come up with the idea of Devskiller? What is the mission behind it?

Have you ever tried Googling “technical hiring is broken”? Many of the stories you’ll find are hard to believe. The waters of technical recruitment are difficult to navigate and the relationship between recruiters and developers is a rocky one, to say the least.

Developers are inundated with recruiter mail and they’re fed up with shoddy technical screening attempts. Recruiters are tired of struggling to improve the quality of candidates they funnel to the dev team only to be criticized for their efforts. Both sides participating in the process are frustrated and unhappy with the end result.

We decided to bring a much-needed change to tech hiring by helping developers and recruiters finally cooperate. We do that in a number of ways.

First of all, we give them our tool. One of the biggest criticisms tech recruiters have to deal with is that they cannot deliver valuable candidates. Because the process is inefficient, these non-viable candidates have to be interviewed by developers who know they’re not a fit 5 minutes into the interview. This problem can be solved by moving technical screening to an earlier stage in the hiring process using an automated tool like our very own Devskiller. We believe that testing candidates should mirror the first day of work experience. We’ve devoted a lot of time working on our RealLifeTesting™ methodology to ensure that tech candidates are given a fair chance to showcase their real coding skills under realistic conditions.

Second of all, we provide educational resources to help technical recruiters better themselves. To put it mildly, developers don’t have much respect for recruiters who think Java and JavaScript are the same things. They want to be approached by people who know what they’re talking about. Yegor Bugayenko, an excellent software engineer wrote a post “You’re Just the Mayonnaise in a Bad Sandwich” which pretty much sums up the feelings some devs have towards recruiters. We want to help recruiters steer away from bad recruitment practices leading to even more frustration.

To do that, we give recruiters educational resources like our free Tech Recruitment Certification Course, ebooks, cheat sheets, and other support materials to maximize their chances of providing great candidates. Being a technical recruiter is a really tall task and we’re trying to make it a little bit easier.


What is special about the assessment of technical talent?

I’d say it’s tricky because most of the time, technical recruiters cannot verify the tech skills necessary to do well in a given job.

Developers are frustrated about being screened by non-technical staff, either through yes/no questions or through what is often called whiteboard hazing. Some companies ask their candidates to solve algorithmic puzzles or invert binary trees. They also don’t allow them to use any resources while being tested. I think assessing technical talent should be based on what you can do and not what you know off the top of your head. I believe the ways of technical screening mentioned above are flawed because they aren’t parallel to real work challenges. According to Frederick D. Smith, work sample tests have high predictive validities and I believe that when it comes to screening technical skills, work sample tests really are the way forward.


Why is it important to test candidates’ technical skills on the screening stage of the recruitment process?

I believe the initial stages of the recruitment process have an immense impact on the final outcome. In other words, if your sourcing and technical screening procedure are inefficient, you’re unlikely to hire great developers.

The earlier you screen technical skills, the better. Our customers see a tremendous difference in the number of technical interviews they need to carry out in order to hire a developer. As an example, a Gothenburg-based technical recruitment agency called Lingonberry Talent Acquisition used to interview 15 developers to make 2 technical hires. By screening their candidates’ coding skills with our tool early in the process, they now only have 4 technical interviews per 2 developers hired. Today, they only interview 11.43% of all candidates as opposed to 21.43% before implementing Devskiller.

Lingonberry’s numbers show you just how important it is to screen out the bad candidates from your recruitment process early on. If you don’t, you’ll keep wasting your precious time.


What are the components of an efficient assessment process?

Technical skill assessment should be automated and should happen early in the process. It should also be supported by means of benchmarks. We typically recommend that one of our customer’s internal developers take the test so that they have a valid benchmark. If that’s not possible, we also have the AI Benchmarking Engine which predicts the likelihood of succeeding for every single candidate.


What is the biggest challenge in testing technical specialists?

I think testing technical skills efficiently translates itself to the employer brand of a company. If the screening process is inefficient or the recruiter seems to lack the required skills, the whole company risks being seen as an undesirable workplace. What is more, the popularity of social media, review sites, and forums means mistakes only a few people would normally see get blown up as if they were put under a magnifying glass. Oftentimes, the most vocal critics are really good developers who don’t come in with a vendetta but feel they need to share how flawed the system is.


How do you attract developers to contribute to your tasks base?

Luckily, the developers we work with see value in what we do and we’re happy with the results of our cooperation. We keep our tasks secure by using social listening tools and our own proprietary content scanner so our tasks stay secure. This shows our contributors that we value their work and want to keep using it as long as we possibly can.

What is more, they’ve had similar experiences with the technical recruitment process and they enjoy creating tasks which really verify coding skills.


You offer various methods to assess the technical skills of the candidate. In what cases each one of them is more relevant?

We see the best results with using a combination of tasks, depending on the skillsets you need to verify. As an example, multiple choice questions are often used at the beginning of the test as a warm-up. Coding review challenges verify familiarity with design patterns and coding practices, and programming tasks allow you to see how candidates solve real coding challenges in a real project environment. All these tasks serve their own purpose and they get selected or not depending on the required skillset.

Ready to start sourcing IT candidates?

AmazingHiring is an AI-based aggregator to source passive IT candidates across the web. It finds people profiles from 50+ networks like GitHub, StackOverflow, Facebook, Kaggle, etc. and provides recruiters with candidates’ professional background, contacts, social footprint. 

Subscribe to AmazingHiring newsletter

  Skills sources   You often ask us, how is the block with skills being formed. Now the answer can be found in the system: just click on the particular skill or technology and you will see the source. Information about the companies Now users have access to information about the companies: who are (or […]

We are glad to announce AmazingHiring system update: this time it is about searching real stars! We have developed new types of ranking, gave away the medals to the real GitHub and Stackoverflow superheroes and collected all the achievements and skills in the full card of the candidate. Ranking It is now possible to rank […]

AmazingHiring attended the #hruNewYork – People Analytics, which was held in the E&Y’s office in New York on March 30. This visit continued the tradition of attending a series of GlobalHRU anti-conferences. As an introduction, it is worth mentioning a few words about the #hru format (for those who have not yet participated in the […]