Show HN: Will Jev pull the lever in the trolley problem?
gpu.studioThe Jev benchmark you've all been waiting for: Will Jev pull the lever in the trolley problem?
Don't think too much about it :)
Place whatever you'd like on each side of the tracks, and GPU (my startup's AI system, whee!) will have Jev judge the result.
As a bonus, two really good looking SVGs are rendered with gpt-oss-120b for what you place on the tracks. I've made a really high quality thing here.
My first impression is that Jev does well! I understand it's not exactly designed for this kind of "classification" -- I think -- but I haven't been able to get it to pull the lever away from any villains or geese yet.
It's public against my better judgement. No account necessary, have fun.
Side presentation: I've put together a more "serious" harness here if you're interested in evaluating Jev for yourself. I've been interested in seeing how well it does if you augment an existing smaller model with it: https://gpu.studio/jev
This is actually a pretty fun benchmark. Curious how consistent Jev is when you change the wording but keep the underlying scenario the same.
nice stick figure, though I'm not immediately sure where the trolley would go (a small animation would go a long way). Also, high-five for getting Jev access.