University of Illinois
Language Models Defy Logic: Large NLP models struggle with logical reasoning.
Who would disagree that, if all people are mortal and Socrates is a person, Socrates must be mortal? GPT-3, for one. Recent work shows that bigger language models are not necessarily better when it comes to logical reasoning.