Research topic

Trustworthy AI

Robust, explainable and privacy-aware machine learning systems for distributed and adversarial security settings.

Trustworthy AIExplainable AIPrivacy-Preserving AI

Trust as an engineering requirement

Trustworthy AI is not a single metric. In security-sensitive systems it combines robustness, explainability, privacy, accountability and evidence that a model behaves acceptably under operational stress.

  • Robustness against noisy data, adversarial clients and distribution shift.
  • Explainability that helps humans inspect model behavior.
  • Privacy-aware design for systems trained across sensitive data holders.

Why distributed settings are harder

Distributed AI systems inherit all the usual machine learning risks and add communication constraints, partial observability, heterogeneous peers and inconsistent incentives. Trustworthy design must address the model, the protocol and the operational context together.

Research represented in the site

The related publications and projects approach trustworthy AI through robust aggregation, decentralized protocols, privacy-preserving learning, explainable mitigation support and evaluation in cyberdefense scenarios.

Frequently asked questions

What makes an AI system trustworthy?

A trustworthy AI system is robust, explainable, privacy-aware, auditable and evaluated under conditions close to the environment where it will be used.

Is explainability enough for trustworthy AI?

No. Explainability is important, but it must be combined with robustness, privacy, evaluation, governance and operational controls.

Why is trustworthy AI important for federated learning?

Federated systems rely on multiple clients and shared updates. Trustworthy design helps detect unreliable contributions, protect sensitive information and keep collaborative learning useful.

Related projects

DEFENDIS: Decentralized Federated Learning for IoT Device Identification and Security

DEFENDIS develops a framework for uniquely identifying IoT devices in a distributed manner while solving security threats through decentralized federated learning.

View Project

ROBUST-6G: Smart, Automated and Reliable Security Service Platform for 6G

ROBUST-6G studies security mechanisms for 6G systems, including monitoring, secure data management, trustworthy AI services, federated learning, and threat response.

View Project

TITAN: Trustworthy and Intelligent Threat Analysis

A project with armasuisse Cyber-Defence Campus investigating trustworthy threat intelligence sharing and verification algorithms.

View Project

DATRIS: Decentralized AI for Trustworthy and Resource-efficient Intelligent Systems

Developed decentralized AI solutions addressing computational constraints and trust validation under armasuisse Cyber-Defence Campus sponsorship.

View Project

Reading path

Move from foundations to design and evaluation. Each note addresses a different question.

All notes on this topic