article thumbnail

Anthropic Claude 3.5 Sonnet ranks number 1 for business and finance in S&P AI Benchmarks by Kensho

AWS Machine Learning Blog

In the following example, for an LLM to answer the question correctly, it needs to understand the table row represents location and the column represents year, and then extract the correct quantity (total amount) from the table based on the asked location and year: Question : What was the Total Americas amount in 2019?

article thumbnail

Commonsense Reasoning for Natural Language Processing

Probably Approximately a Scientific Blog

Representing symbolic knowledge as vectors: Lin et al. 2019) used BERT as the neural component to represent the instance (statement vector). 2019) fine-tuned a BERT model to solve the multiple choice questions. COMET has been used successfully in various downstream tasks requiring commonsense knowledge.