Tool call execution through user prompt injection (CSRF) of the llama-server Web UI
Published:
A user prompt injection vulnerability (CSRF) in the llama-server (llama.cpp) Web UI (Reprompt-like) allows attackers to inject arbitrary user prompt with query parameter (?q=...), potentially leading to arbitrary shell command execution, data exfiltration, etc. (through tool calls).
An user prompt injection vulnerability (CSRF) both in in the e Chat (Mistral) and Grok (Reprompt-style) allows attackers to inject user prompt with query parameter (?q=...) potentially leading data exfiltration.
Reprompt-style vulnerability in Le Chat (Mistral) and Grok.
Some notes on how transformer-decoder language models work, taking GPT-2 as an example, and with lots references in order to dig deeper. This is intended both as a a roadmap for understanding on how LLMs work (especially the ones using a transformer-decoder architecture) and a a summary/recap on the topic.