article thumbnail

Commonsense Reasoning for Natural Language Processing

Probably Approximately a Scientific Blog

With that said, the path to machine commonsense is unlikely to be brute force training larger neural networks with deeper layers. Is commonsense knowledge already captured by pre-trained language models? In the last 3 years, language models have been ubiquitous in NLP.