Home | deutsch  | Sitemap | Legals | Data Protection | KIT

Risks of discrimination by algorithms

Risks of discrimination by algorithms
Project team:

Orwat, Carsten (Project leader); Reinhard Heil, Oliver Siemoneit


Federal Anti-Discrimination Agency

Start date:


End date:


Research group:

Innovation processes and impacts of technology

Project description

Nowadays, digital information and communication technologies permeate almost all areas of life and generate extensive volumes of data, which could also be applied for automated decision making about individuals using advanced methods of data processing and analysis.

In this context, rules for social interactions, behavioral steering, and decision making are increasingly embedded in software, automatically enforced, and technically implemented. On the one hand, this may contribute to preventing human errors and biases in decision making. On the other hand, it may increase the risks of discrimination of protected groups and new types of discriminations may emerge.

The research project collected and analyzed cases where discrimination has become known involving algorithms, data sets, operators or users in order to identify causes, contexts, types and dimensions of discrimination and discrimination risks. This included questions relating to self-determination, justice, fairness, responsibility or data protection.

Based on this, options for action were derived and discussed, inter alia in comparison with existing legal frameworks. The project was funded by the Federal Anti-Discrimination Agency for a period of one year.



Dr. Carsten Orwat
Karlsruhe Institute of Technology (KIT)
Institute for Technology Assessment and Systems Analysis (ITAS)
P.O. Box 3640
76021 Karlsruhe

Tel.: +49 721 608-26116