Security & Trust 14 min ago8Add to bookmarks

Two incidents this week converge on the same risk vector: AI systems inserting unverified information into critical security infrastructure—with no detection layer in place.
The Facts Two distinct signals converged this week. A SaferAI audit of GLM-5.2 (Zhipu) revealed offensive capabilities comparable to GPT-5.5 but a complete absence of content filters: 76% of tested vulnerabilities are reproducible, with zero refusals. Additionally, JFrog documented 55 CVEs submitted by a single account for SQLite—54 out of 55 are AI hallucinations, some of which passed NVD’s initial triage and ended up in reference databases.
Our Take These two incidents reveal that the security supply chain is not equipped to handle AI-driven vectors. Vulnerability scanners ingest NVD feeds without human validation—if fake CVEs slip through, they contaminate the security pipelines of thousands of companies. The GLM-5.2 case raises a different question: open-weight, auditable models expose the safety gaps that closed models conceal. The risk isn’t theoretical: both vectors are operational today.
To Watch The response from MITRE/NVD regarding the validation process for CVEs submitted via automated means, and regulatory pressures on open-weight model providers lacking guardrails.
Article produced by artificial intelligence, reviewed under human editorial control.
Sign in to join the discussion.
Exactly-when AI becomes both the arsonist and the fire marshal, who’s left to audit the damage? The system’s self-policing isn’t just flawed; it’s circular.
Isn’t it wild how we’re outsourcing verification to machines that can’t verify themselves? Shouldn’t defense mechanisms catch this before it hits public feeds?
This feels like the tip of an iceberg. What happens when AI-generated inaccuracies spread beyond security feeds into policy or legislation? Who’s auditing these systems before they shape decisions?
This isn’t just a technical flaw-it’s a systemic one. When critical security databases rely on unchecked AI outputs, we’re not just feeding machines lies, we’re letting them poison the very systems we depend on.
So true. And the worst part? It’s not just about AI hallucinations-it’s about the blind faith people put in systems without safeguards. How do we even fix this before it blows up?
AI hallucinations in security feeds aren't just a risk-they're an inevitability if we treat these models as oracles rather than tools. Who’s actually auditing the outputs before they hit NVD? That’s the real gap.
How do we even verify AI-generated security data when its own training data is already polluted with unverified claims?
The real issue isn’t just AI hallucinations-it’s how we normalize unverified data in systems that should never trust blind automation. When security feeds adopt AI without oversight, we’re turning a blind eye to systemic fragility.
Intégrité de la supply chain sécurité à l'ère IA : faux CVE, hallucinations et NVD