Career

What’s Your Geek Number? My Points System To Rate Software Engineers

The ability to quickly and accurately rate the ability of software engineers after reading a résumé and conducting a relatively brief screening (as compared to full interviews) is very useful for those of us who recruit technologists. This skill is one of the elements that separates great recruiters from the rest, and it is admittedly not an exact science.

As an experienced recruiter, I often work with candidates that I have represented in the past, so I will have the benefit of historical data to assess how strong a candidate’s skills are and how well he/she will perform. This data typically will include feedback from past job interviews, referrals from other engineers, discretionary ‘word on the street’ reference checks, and knowledge of a candidate’s job history.

But how do I make a judgment on a new candidate that has no experience or history with me? I receive a résumé, we have a conversation, and I have to make the call as to whether this person is a top candidate. Without going into a deep technical interview, how do I surmise how strong this engineer’s technical skills are? This is one of the reasons clients hire me, as my screening should save them time to weed out those that are not qualified.

After fourteen years in the business, I have noticed some distinct patterns regarding behaviors, traits, and small details that are shared by many of the top software engineers. Conversely, there are some noticeable trends that are indicative of engineers that are probably not in the top tier. For the sake of clarity, my definition of ‘top’ engineers is based on successful job interviews with clients, on the job performance while working for clients, and substantial anecdotal evidence from an engineer’s peers (the peer piece often being the most substantial factor).

Below I have compiled a ‘points system’ for software engineers, with an assigned value for each characteristic. As you can see, some items are worth positive points, while other traits take points away. Again, this is by no means an exact science, and I imagine we will get some false positives (i.e. it is possible that some average engineers could score high), but I sincerely doubt many great engineers would score low. Although I have used some of these characteristics to help loosely evaluate engineering talent in the past, I have never assigned any specific points values until now.

What does my points score mean? A score in the high 20?s should be where we start seeing engineers that probably take their career pretty seriously and are willing and able to invest some time in bettering themselves. A score in the 30?s would certainly be indicative of a candidate I would expect to perform well more often than not, and above 40 I would expect all candidates to be in the top tier. I know a few engineers who score in the 50 range and higher, and I don’t think you will find any individuals that are not widely admired and respected at this point level.

To be clear, I’m certainly not saying that engineers with blogs are always technically superior, or that having a five page résumé somehow makes you a bad engineer. The assigned points value are not how much that characteristic should be ‘valued’ by an employer, but rather the strength of the indicator. (Note the highest point value is assigned to Linux kernel work, which I have found in my experience to be the strongest indicator of good engineers – not all good engineers hack the kernel, but all engineers who hack the kernel are good.) These are simply patterns that I have observed while talking to thousands of engineers, and I’m sure many of you will disagree. Critiques are welcome – even encouraged (just be polite). If you have found indicators of great (or poor) engineers, I’d love to hear them – even if they are odd. Let’s debate!

(As my business is focused on engineers working within a specific set of languages primarily geared towards the open source world, this list is focused on fit for my purposes. Those who work in Microsoft shops or develop embedded software, for example, might not score as well due to the open source leanings here.)

POSITIVE POINTS

  • Linux kernel hacking, just for fun +7
  • Committer/contributor to open source project(s) +6
  • Technical patent +6
  • Speaker at conferences/group events +5
  • Blog about tech (even if only occasionally) +4
  • Attend user groups/meetups at least once a month +4
  • Regular reader of tech books/blogs +4
  • Speaker at in-house company trainings +4
  • Master’s in Computer Science +3
  • Tech hobby with mobile platforms, robotics, Arduino +3
  • Run Linux or other Unix flavor at home +3
  • Published author/editor of book or web material +3 articles +8 books
  • Start-up/entrepreneurial experience +3
  • Active projects on GitHub, Sourceforge, Heroku, similar +2 each
  • In addition to your main ‘paid’ language/platform, some level of fluency in any of the following: Java, C++, Scala, Clojure, Lisp, Ruby, Erlang, Python, Haskell, iPhone/Android platform +5 per language

QUICK ASIDE: Another element I tend to include in the ‘plus’ category is work experience for (+5) or a job offer (+2) from a certain subset of employers. Why? Because I know firsthand that these employers have very high standards in hiring and rarely make bad hires, so odds are if you have worked for or have been offered employment by one of these companies you are very likely good at what you do. I can’t make this list public, but I share this just to let you know another contributing factor.

NEGATIVE POINTS

  • Worked over 12 years for current employer (few exceptions) -10
  • Worked over 6 years for current employer (few exceptions) -5
  • Only run Windows at home -5
  • 40+ tech buzzwords or acronyms on your résumé -5
  • AOL email address -4
  • Résumé is over three pages -4
  • Having three or more permanent jobs in a given two year period -4
  • GPA/SAT score on résumé and 10+ years experience -2

Reference: What’s Your Geek Number? My Points System To Rate Software Engineers (without a full technical interview) from our JCG partner Dave Fecak at the Job Tips For Geeks blog.

Dave Fecak

Dave Fecak has been recruiting software engineers for start-ups since 1998 and he has served as the founder and president of the Philadelphia Area Java Users’ Group since 2000. Dave is often cited and published on career topics for technology professionals, and he blogs at JobTipsForGeeks.com.
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

8 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Ali Sadreddini
Ali Sadreddini
10 years ago

what happens to the poor new graduate who has yet to learn all the new things out there in the real world?

Claudio Ludovico Panetta

Quick! Delete all AOL Emails hahaha

Null Prime
Null Prime
10 years ago

If you have yet to learn all the new things I would guess you’re not a “top candidate.” Also if you’re main contact email address is AOL (or Hotmail) that’s just plain weird. Same goes for only running Windows or even worse IOS (MAC).

Arash
Arash
10 years ago

Another recruiter judging developers,

how stupid is it to grade like this?

Technical patent +6
Regular reader of tech books/blogs +4

JS
JS
9 years ago
Reply to  Arash

Yeah it’s ridiculous, this guy is ridiculous. If I had a “Technical patent +6”, why would I apply for a job this guy is hiring for? It’d be so far below me I wouldn’t even return this guy’s phone-calls. Though, I guess it’d be more advantageous to sit in my basement to engage in “Linux kernel hacking, just for fun +7”, unrecognized and unnoticed. I guess it’s to get his quota of “Blog about tech (even if only occasionally) +4”, which apparently is more important than “Start-up/entrepreneurial experience +3”. Oh wait, I just got my “Regular reader of tech books/blogs… Read more »

Dave Fecak
9 years ago
Reply to  JS

I wrote this, so definitely don’t return my phone calls! The article was intended to show some indicators I’ve seen of good engineers and bad ones from 2012. I’d definitely assign different values in 2015 (things like patent shouldn’t be on the list at all), and I agree that the entrepreneurial experience is valued more today than just a quarterly blog post. The values themselves can certainly be debated, or even mocked. If it’s not obvious, I’ve never ‘added up’ points on a candidate, but I’ve had strong engineers reach out to me and say “I’m a 12, am I… Read more »

Jody
Jody
10 years ago

I’d add points for having unbridled curiosity about absolutely everything: grammar, auto mechanics, containerization, leaky faucets, the American legal system, the history of intelligence testing…people who are interested in everything and anything that comes their way.

This quality indicates a natural pleasure in learning, a bent towards original thinking, and a certain (almost naive-seeming) fearlessness about momentarily appearing dumb.

Simon Thompson
9 years ago

I’m still trying to figure out my geek number. lol

Back to top button