Allow candidates to use LLMs in job interviews
clientserver.devIt’s simple. The solution to dealing with LLMs is:
* Don’t ask code questions. If I want to know about code I will ask the candidate to tell me about the methods of their favorite Node library. That leaves it up to the candidate to form an original answer because the LLM needs further direction, such as which Node library to look up.
* Make your questions really long with many words, such as throwing a situation in the middle and then circle back on a prior mentioned premise. The LLMs will barf and the candidate will actually have to address the question on their own versus reading the LLMs nonsense.
* Ask your next question very fast after their prior answer, almost before they finish speaking, and watch for if they are speaking or reading from a screen.
* Ask the candidate about performance improvement techniques in their prior code or transmission and then ask them when they have noticed these savings in production. For the LLM that is two entirely separate things to answer. Also, most developers cannot measure anything.