Settings

Theme

LLM Integrity During Inference in Llama.cpp

bednarskiwsieci.pl

1 points by piotrbednarsalt 4 months ago · 1 comment

Reader

piotrbednarsaltOP 4 months ago

As local inference for language models becomes more popular, issues that until recently sat at the margins of AI security discussions are becoming increasingly important. Much of the debate still focuses on the application layer, especially prompt injection, data poisoning, jailbreaks, or the security of RAG integrations. Far less attention is given to the integrity of the model artifact itself during inference.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection