Mechanistic interpretability

Mechanistic interpretability (sometimes abbreviated as mech interp, mechinterp, or MI) is a subfield of research within explainable artificial intelligence that aims to understand the internal workings of neural networks by analyzing their concrete structures, algorithms and circuits. This approach seeks to analyze neural networks in a manner similar to the reverse engineering of conventional software.

Source: Wikipedia — Mechanistic interpretability (CC BY-SA 4.0)