Settings

Theme

AI vs. the cheating: lessons from building a national exam integrity system

2 points by leekuanyew 2 months ago · 2 comments · 2 min read


A couple of years ago, our small team was asked to help secure the driver’s license theory exam for an entire country.

It sounded simple: build a system to detect cheating and improve transparency. In reality, we uncovered an entire underground industry.

There were micro-earpieces hidden in collars, cameras inside keyboards, remote helpers watching live feeds, even analog VGA splitters used to bypass screen capture. The more we built defenses, the more creative the cheating networks became. And it wasn’t just local — we found similar patterns reported around the world in GMAT, GRE, IELTS, TOEFL, and professional certifications. Cheating has become industrialized.

We built an AI-based proctoring system that combines computer vision, behavioral analytics, and biometric verification linked to Kazakhstan’s national ID database. We also developed a custom hardware scanner that can detect micro-earpieces invisible to normal detectors.

Since the national rollout in late 2023: • Over 1.2 million exams have been conducted. • The pass rate dropped nearly threefold, once fake attempts disappeared. • The number of driver’s licenses issued fell from about 1.1 million → 620 thousand — not due to lower demand, but because the process finally became honest.

The biggest lesson: this isn’t a technical project, it’s an ecosystem problem. Every time we close one loophole, someone invests in finding another. It’s a constant cat-and-mouse dynamic that feels closer to cybersecurity than education.

I’d love to hear thoughts from people who’ve worked on: – Scaling GovTech / AI systems internationally while keeping public trust. – Adapting products for different data-sovereignty and privacy frameworks. – Using “ethical hacking” or adversarial testing as a go-to-market model for regulated industries.

Not trying to sell anything — genuinely curious how others have navigated these problems at scale.

(If you’re interested in the full background and stats, we wrote a longer breakdown here: https://medium.com/@yyermanov/how-kazakhstan-reinvented-driver-testing-with-ai-and-cut-fraud-in-half-b10755ed32ac)

lucideng 2 months ago

This is a fun thought exercise.

Pen and paper only? Lock them in a faraday cage to keep RF from going in or out? RF jamming? In-person testing only. No devices, period. Supply hearing aids, glasses and even clothing if you have to.

AI systems can be fooled, people can be bribed, cameras and detectors can miss things. To me it's a risk vs reward equation. If the risk of getting caught is greater than cheating, people will generally not want to cheat. If there is no risk at cheating and only something to gain, cheating will be rampant. If you get caught cheating and there is no jail time, no financial risk, and you can take the test again... why not cheat? Make the barrier to cheat incredibly high and the cost of cheating even higher.

gus_massa 2 months ago

Is it a remote exam?

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection