Settings

Theme

Ask HN: Have you noticed decreased quality in GPT-4 reasoning recently?

4 points by ammar_x 3 years ago · 5 comments · 1 min read

Reader

I noticed a significant decrease in the model reasoning abilities in the last few days, especially when it comes to writing code. Has anyone else experienced this?

Given that these models are being used in all sorts of applications all over the world, I think it's concerning that OpenAI can lobotomize a model in secret and no one can verify that and do something about it.

skilled 3 years ago

As an EU user, I feel like it has been watered down a lot, both 3.5 and 4. Many queries now come with disclaimers which are pretty annoying since you can't set your own system instructions in the ChatGPT interface. Using the API is fine though since you can explicitly say that you want a specific format.

  • rainy59 3 years ago

    true they could be fiddling w things as the EU AI Act moves forward

    • monkeydust 3 years ago

      Wouldn't surprise me if members of EU parliament and comission were big time customers now via the OpenAI playground.

rainy59 3 years ago

The more they force the model into politically-fashionable responses, the further they get away from rational thought process. CodeT5+ looks promising though

mdp2021 3 years ago

> concerning

...And in fact some at Google are already projecting a future of Open Source dominance in the subfield.

(Edit: the system must have missed a post update: )

...Coincidentally, in fact, a neighbouring post is: OpenAI readies new open-source AI model - https://news.ycombinator.com/item?id=35958789

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection