3 min readGuide
Golden Sets for LLM Evaluation: Small, Curated and Difficult to Cheat
Build golden sets for LLMs and RAG with examples, adjudication, leakage-aware splits and bilingual security cases.
Research Notes on Federated Learning, Cybersecurity and Cyberdefense
Research notes and technical guides on federated learning, distributed AI, cyberdefense, trustworthy systems, and privacy-preserving platforms.
Topic: LLMs for Cyberdefense Support Clear topic
12 articles. Page 2 of 2.
3 min readGuide
Metrics for LLMs, RAG and Cybersecurity Systems
LLM and RAG metrics: retrieval recall, citations, unsafe actions, calibration, latency and uncertainty. Define fair comparisons.
5 min readResearch note
How to Measure Robustness in Adversarial DFL Experiments
Evaluate DFL robustness with F1, false rejection, overhead and recovery. Interpret Flighter and compare clean and attacked conditions.
5 min readResearch note
Flighter: Situational Awareness as a Reliability Signal in DFL
How Flighter combines context and models to evaluate DFL reliability: study scope, indicator ablations and participant recovery.
5 min readResearch note
From Monitoring to Mitigation: A DFL Cyberdefense Lifecycle with LLM Explanations
Connect telemetry, federated learning, alerts and LLM-assisted mitigation with traceable evidence, validation and reviewed feedback.
3 min readResearch note
Byzantine-Resilient Aggregation for Decentralized Federated Learning
Median, trimmed mean and trust in DFL: examples, local poisoning assumptions and defense costs with legitimate non-IID clients.