Publications

2024

Applying Intrinsic Debiasing on Downstream Tasks: Challenges and Considerations for Machine Translation
Bar Iluz, Yanai Elazar, Asaf Yehudai, Gabriel Stanovsky
EMNLP

Schema-Driven Information Extraction from Heterogeneous Tables
Fan Bai, Junmo Kang, Gabriel Stanovsky, Dayne Freitag, Mark Dredze, Alan Ritter
EMNLP Findings

State of What Art? A Call for Multi-Prompt LLM Evaluation
Moran Mizrahi, Guy Kaplan, Dan Malkin, Rotem Dror, Dafna Shahaf, Gabriel Stanovsky
TACL (@ ACL)
CODE

Instructed to Bias: Instruction-Tuned Language Models Exhibit Emergent Cognitive Bias
Itay Itzhak, Gabriel Stanovsky, Nir Rosenfeld, Yonatan Belinkov
TACL (@ ACL)
CODE

Leveraging Collection-Wide Similarities for Unsupervised Document Structure Extraction
Gili Lior, Yoav Goldberg, Gabriel Stanovsky
ACL Findings
CODE

K-QA: A Real-World Medical Q&A Benchmark
Itay Manes, Naama Ronn, David Cohen, Ran Ilan Ber, Zehavi Horowitz-Kugler, Gabriel Stanovsky
BioNLP Workshop
CODE

Navigating the Modern Evaluation Landscape: Considerations in Benchmarks and Frameworks for Large Language Models
Leshem Choshen, Ariel Gera, Yotam Perlitz, Michal Shmueli-Scheuer, Gabriel Stanovsky
Tutorial at LREC-COLING
SLIDES BIB

Do Zombies Understand? A Choose-Your-Own-Adventure Exploration of Machine Cognition
Ariel Goldstein, Gabriel Stanovsky
ACL Findings

2023

WHOOPS! A Vision-and-Language Commonsense Benchmark of Heterogeneous Objects and Situations
Nitzan Bitton-Guetta*, Yonatan Bitton*, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
ICCV
PROJECT

Evaluating and Improving the Coreference Capabilities of Machine Translation Models
Asaf Yehudai, Arie Cattan, Omri Abend, Gabriel Stanovsky
EACL

Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution
Gili Lior and Gabriel Stanovsky
CogSci
CODE

Exploring the Impact of Training Data Distribution and Subword Tokenization on Gender Bias in Machine Translation
Bar Iluz, Tomasz Limisiewicz, Gabriel Stanovsky, David Mareček
AACL
CODE

VASR: Visual Analogies of Situation Recognition
Yonatan Bitton, Ron Yosef, Eli Strugo, Dafna Shahaf, Roy Schwartz, Gabriel Stanovsky
AAAI

You Can Have Your Data and Balance It Too: Towards Balanced and Efficient Multilingual Models
Tomasz Limisiewicz, Dan Malkin and Gabriel Stanovsky
SIGTYP

The Perfect Victim: Computational Analysis of Judicial Attitudes towards Victims of Sexual Violence
Eliya Habba, Renana Keydar, Dan Bareket, and Gabriel Stanovsky
ICAIL

A Large-Scale Multilingual Study of Visual Constraints on Linguistic Selection of Descriptions
Uri Berger, Lea Frermann, Gabriel Stanovsky, Omri Abend
EACL Findings

Are Layout-Infused Language Models Robust to Layout Distribution Shifts? A Case Study with Scientific Documents
Catherine Chen, Zejiang Shen, Dan Klein, Gabriel Stanovsky, Doug Downey, Kyle Lo
ACL Findings

2022

Winogavil: Gamified association benchmark to challenge vision-and-language models
🎉 Selected as Featured Presentation
Yonatan Bitton, Nitzan Bitton Guetta, Ron Yosef, Yuval Elovici, Mohit Bansal, Gabriel Stanovsky, Roy Schwartz
NeurIPS Datasets and Benchmarks

Covid vaccine is against Covid but Oxford vaccine is made at Oxford! Semantic Interpretation of Proper Noun Compounds
Keshav Kolluru, Gabriel Stanovsky, Mausam
EMNLP

GENIE: A Leaderboard for Human-in-the-Loop Evaluation of Text Generation
Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, Daniel S. Weld
Media coverage: VentureBeat
EMNLP
PROJECT

A Computational Acquisition Model for Multimodal Word Categorization
Uri Berger, Gabriel Stanovsky, Omri Abend, Lea Frermann
NAACL

A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank
🎉 Won an Outstanding Paper Award
Dan Malkin, Tomasz Limisiewicz, Gabriel Stanovsky
NAACL

On the Limitations of Dataset Balancing: The Lost Battle Against Spurious Correlations
Roy Schwartz, Gabriel Stanovsky
NAACL Findings

2021

Automated Extraction of Sentencing Decisions from Court Cases in the Hebrew Language
Mohr Wenger, Tom Kalir, Noga Berger, Carmit Chalamish, Renana Keydar, Gabriel Stanovsky
NLLP

Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach
Koren Lazar, Benny Saret, Asaf Yehudai, Wayne Horowitz, Nathan Wasserman, Gabriel Stanovsky
Media coverage: Daily Mail, NewScientist
EMNLP
CODE

Data Efficient Masked Language Modeling for Vision and Language
Yonatan Bitton, Gabriel Stanovsky, Michael Elhadad, Roy Schwartz
EMNLP Findings
CODE

Collecting a Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation
Shahar Levy, Koren Lazar, Gabriel Stanovsky
EMNLP Findings
CODE

Realistic Evaluation Principles for Cross-document Coreference Resolution
Arie Cattan, Alon Eirew, Gabriel Stanovsky, Mandar Joshi and Ido Dagan
STARSEM
CODE

Cross-document Coreference Resolution over Predicted Mentions
Arie Cattan, Alon Eirew, Gabriel Stanovsky, Mandar Joshi and Ido Dagan
ACL Findings
CODE

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA
Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad
NAACL
CODE

Process-Level Representation of Scientific Protocols with Interactive Annotation
Ronen Tamari, Fan Bai, Alan Ritter, Gabriel Stanovsky
EACL
PROJECT

Gender Trends in Computer Science Authorship
Lucy Lu Wang, Gabriel Stanovsky, Luca Weihs, Oren Etzioni
Communications of the ACM
Media coverage: New York Times, Science, AXIOS, GeekWire
BIB

2020

Gender Coreference and Bias Evaluation at WMT
Tom Kocmi, Tomasz Limisiewicz, Gabriel Stanovsky
Conference on Machine Translation (WMT20)
CODE

MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metrics
Anthony Chen, Gabriel Stanovsky, Sameer Singh, Matt Gardner
EMNLP
PROJECT-PAGE BIB

The Right Tool for the Job: Matching Model and Instance Complexities
Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah Smith
ACL
CODE TALK BIB

Crowdsourcing a High-Quality Gold Standard for QA-SRL
Paul Roit, Ayal Klein, Daniela Stepanov, Jonathan Mamou, Julian Michael, Gabriel Stanovsky, Luke Zettlemoyer, Ido Dagan
ACL
TALK BIB

Active Learning for Coreference Resolution using Discrete Annotation
Belinda Li, Gabriel Stanovsky, Luke Zettlemoyer
ACL
Annotation-interface CODE TALK BIB

Ecological Semantics: Programming Environments for Situated Language Understanding
Ronen Tamari, Gabriel Stanovsky, Dafna Shahaf, Reut Tsarfaty
BAICS workshop at ICLR2020
DEMO TALK BIB

2019

Evaluating Gender Bias in Machine Translation
🎉 Nominated for Best Paper award (top 1% of submissions)
Gabriel Stanovsky, Noah Smith, Luke Zettlemoyer
ACL
BLOG CODE TALK SLIDES POSTER BIB

SemEval-2019 Task 10 - Math Question Answering
Mark Hopkins, Ronan Le Bras, Cristian Petrescu-Prahova, Gabriel Stanovsky, Hannaneh Hajishirzi, Rik Koncel-Kedziorski
SemEval
CodaLab BIB

DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dheeru Dua, Yizhong Wang, Pradeep Dasigi, Gabriel Stanovsky, Sameer Singh and Matt Gardner
NAACL
PROJECT BIB

Y’all should read this! Identifying Plurality in Second-Person Personal Pronouns in English Texts
Gabriel Stanovsky, Ronen Tamari
Workshop on Noisy User-generated Text (W-NUT), EMNLP workshop
DATA POSTER BIB

Evaluating Question Answering Evaluation
🎉 Won the Best Paper award
Anthony Chen, Gabriel Stanovsky, Sameer Singh and Matt Gardner
Machine Reading for Question Answering (MRQA), EMNLP workshop
BIB

On the Limits of Learning to Actively Learn Semantic Representations
🎉 Honorable mention for best paper
Omri Koshorek, Gabriel Stanovsky, Yichu Zhou, Vivek Srikumar and Jonathan Berant
CoNLL
BIB

2018

Spot the Odd Man Out; Exploring the Associative Power of Lexical Resources
Gabriel Stanovsky, Mark Hopkins
EMNLP
CODE POSTER BIB

Semantics as a Foreign Language
Gabriel Stanovsky, Ido Dagan
EMNLP
TALK SLIDES BIB

Supervised Open Information Extraction
Gabriel Stanovsky, Julian Michael, Luke Zettlemoyer, Ido Dagan
NAACL
DEMO CODE POSTER BIB

Crowdsourcing Question-Answer Meaning Representations
Julian Michael, Gabriel Stanovsky, Luheng He, Ido Dagan, Luke Zettlemoyer
NAACL
DATA CODE BIB

2017

Integrating Deep Linguistic Features in Factuality Prediction over Unified Datasets
Gabriel Stanovsky, Judith Eckle-Kohler, Yevgeniy Puzikov, Ido Dagan and Iryna Gurevych
ACL
DEMO CODE SLIDES POSTER BIB

Acquiring Predicate Paraphrases from News Tweets
Vered Shwartz, Gabriel Stanovsky, and Ido Dagan
STARSEM
CODE BIB

A Consolidated Open Knowledge Representation for Multiple Texts
Rachel Wities, Vered Shwartz, Gabriel Stanovsky, Meni Adler, Ori Shapira, Shyam Upadhyay, Dan Roth, Eugenio Martinez Camara, Iryna Gurevych, Ido Dagan
EACL, LSDSem Workshop
CODE SLIDES POSTER BIB

Recognizing Mentions of Adverse Drug Reaction in Social Media Using Knowledge-Infused Recurrent Models
Gabriel Stanovsky, Daniel Gruhl, Pablo N. Mendes
EACL
DATA SLIDES POSTER BIB

2016

Modeling Extractive Sentence Intersection via Subtree Entailment
Omer Levy, Ido Dagan, Gabriel Stanovsky, Judith Eckle-Kohler, Iryna Gurevych
COLING
CODE BIB

Creating a Large Benchmark for Open Information Extraction
Gabriel Stanovsky, Ido Dagan
EMNLP
CODE SLIDES BIB

Porting an Open Information Extraction System from English to German
Tobias Falke, Gabriel Stanovsky, Iryna Gurevych, Ido Dagan
EMNLP
CODE POSTER BIB

Annotating and Predicting Non-Restrictive Noun Phrase Modifications
Gabriel Stanovsky, Ido Dagan
ACL
CODE POSTER BIB

Specifying and Annotating Reduced Argument Span Via QA-SRL
Gabriel Stanovsky, Meni Adler, Ido Dagan
ACL
SLIDES BIB

Getting More Out Of Syntax with PropS
Gabriel Stanovsky, Jessica Ficler, Ido Dagan, Yoav Goldberg
arXiv preprint, March
CODE SLIDES BIB

2015

Open IE as an Intermediate Structure for Semantic Tasks
Gabriel Stanovsky, Ido Dagan, Mausam
ACL
OIE-EMBEDDINGS SLIDES BIB

2014

Proposition Knowledge Graphs
Gabriel Stanovsky, Omer Levy, Ido Dagan
COLING, AHA Workshop
SLIDES POSTER BIB

Intermediary Semantic Representation Through Proposition Structures
Gabriel Stanovsky, Jessica Ficler, Ido Dagan, Yoav Goldberg
ACL, Semantic Parsing Workshop
POSTER BIB