←back to thread

Ask HN: What are good questions to ask in a remote round in post GPT era?

4 points ashu1461 | 5 comments | 04 Jul 25 02:31 UTC | HN request time: 1.056s | source

Almost all candidates nowadays seem to have some form of external help or LLM-based assistance setup during remote interviews.

This makes it increasingly difficult to fairly assess a candidate's actual skills and independent thinking ability.

How are interview processes changing at your company — or at places where you're interviewing — to adapt to this new reality?

Are there any new patterns, tools, or formats you're using to ensure a fair evaluation?

1. scarface_74 ◴[04 Jul 25 03:02 UTC] No.44460805[source]▶
Nothing changes. I ask them to describe the project that they are most proud of or they found the most challenging and ask them to describe the business and technical implementation and dig into their thinking process.

I have a standard set of behavioral questions.

replies(1): >>44460869 #
2. ashu1461 ◴[04 Jul 25 03:12 UTC] No.44460869[source]▶
This definitely helps, but what about the programming or implementation rounds ?
replies(1): >>44460999 #
3. scarface_74 ◴[04 Jul 25 03:50 UTC] No.44460999[source]▶
Unpopular opinion, if your company is like 90% of the companies, you’re doing boring framework CRUD development. Your candidates don’t need to reverse a b tree on the white board while riding a unicycle on a tightrope.

The complexity in most development is managing business complexity and a large code base. You’re not going to be able to suss that out by coding interview.

System design based on their actual experience and behavioral questions are better anyway.

Besides if your coding interview can be passed by using an LLM and your day to day coding can’t, by definition your interview isn’t an accurate assessment of whether they can do the job.

replies(1): >>44461781 #
4. ashu1461 ◴[04 Jul 25 06:48 UTC] No.44461781{3}[source]▶
The assumption that every programming round is a b tree reversal is not right, and I think programming rounds tell a lot about the candidates thought process, how they structure the code, how they handle edge cases and a lot of other things.

Both system design / verbal discussions and programming rounds are critical to the interview process.

replies(1): >>44463334 #
5. tkiolp4 ◴[04 Jul 25 10:48 UTC] No.44463334{4}[source]▶
What’s the percentage of the engineers at your company who could pass your current interview? If that number is not 100%, your interview process is rather useless.