Back to events
Safety
Score 80Heat 0
How Abliterated Open Models Can Carry Backdoors and Compromise Developer Environments
ResearchAI CodingModel SecurityAlignmentQwenHugging FaceProjectDiscovery
Summary
ProjectDiscovery researchers demonstrate how low-cost fine-tuning and weight editing (such as abliterating safety refusals) can embed stealthy backdoors into open-source language models. Tested on developer tools like Codex CLI, backdoored models execute hidden payloads to exfiltrate credentials upon triggering phrases.
Why it matters
It exposes a critical supply-chain security risk in downloading unverified or modified open-weights models from public repositories for development environments.
Editorial score
2 reviews8
Significance
7.5
Novelty
8.5
Credibility
8
Reach
8
Actionability