CSE Colloquium: Trustworthy NLP: A Causal Perspective

Click here to join via Zoom »

Abstract:

Natural language processing systems have achieved high levels of accuracy on many benchmark datasets, yet it is unclear whether these same systems can be trusted in high-stakes settings. This talk identifies some key desiderata for more trustworthy natural language processing and argues that progress can be made by treating learning and inference as causal systems. In particular, Eisenstein will focus on counterfactual invariance – the notion that predictions should be invariant to interventions on causally-irrelevant variables, which can be formalized in checklist-style evaluations. Eisenstein will present a method for achieving counterfactual invariance by designing regularizers around the causal structure of the data-generating process. For some causal structures, the resulting counterfactually-invariant predictors are optimal with respect to a class of “causally-compatible” perturbations of the data generating process. Empirically, these predictors avoid spurious correlations and transfer well to new data distributions. He will also touch on other connections between causality and natural language processing highlighted in the recent survey by Feder et al (2021).

Speaker Bio:

Jacob Eisenstein is a research scientist at Google, where he is focused on making language technology more robust and trustworthy. He was previously on the faculty of the Georgia Institute of Technology, where he supervised six successful doctoral dissertations, received the NSF CAREER Award for research on computational sociolinguistics and wrote a textbook on natural language processing. He completed his Ph.D. at MIT with a dissertation on computational models of speech and gesture.

 

Share this event

facebook linked in twitter email

Media Contact: Becky Passonneau

 
 

About

The School of Electrical Engineering and Computer Science was created in the spring of 2015 to allow greater access to courses offered by both departments for undergraduate and graduate students in exciting collaborative research fields.

We offer B.S. degrees in electrical engineering, computer science, computer engineering and data science and graduate degrees (master's degrees and Ph.D.'s) in electrical engineering and computer science and engineering. EECS focuses on the convergence of technologies and disciplines to meet today’s industrial demands.

School of Electrical Engineering and Computer Science

The Pennsylvania State University

207 Electrical Engineering West

University Park, PA 16802

814-863-6740

Department of Computer Science and Engineering

814-865-9505

Department of Electrical Engineering

814-865-7667