INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers
INSPECT: Intrinsic and Systematic Probing Evaluation for Code Transformers
Pre-trained models of source code have recently been successfully applied to a wide variety of Software Engineering tasks; they have also seen some practical adoption in practice, e.g. for code completion. Yet, we still know very little about <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">what</i> these pre-trained models learn about source code. In this …