Remove BERT Remove Computational Linguistics Remove Data Science
article thumbnail

Explosion in 2019: Our Year in Review

Explosion

The update fixed outstanding bugs on the tracker, gave the docs a huge makeover, improved both speed and accuracy, made installation significantly easier and faster, and added some exciting new features, like ULMFit/BERT/ELMo-style language model pretraining. Sep 24: Data science instructor Vincent returned for “Intro to NLP with spaCy #2”.

NLP 52
article thumbnail

2022: We reviewed this year’s AI breakthroughs

Applied Data Science

The first computational linguistics methods tried to bypass the immense complexity of human language learning by hard-coding syntax and grammar rules in their models. Applied Data Science Partners is a London based consultancy that implements end-to-end data science solutions for businesses, delivering measurable value.

article thumbnail

The State of Multilingual AI

Sebastian Ruder

Research models such as BERT and T5 have become much more accessible while the latest generation of language and multi-modal models are demonstrating increasingly powerful capabilities. Given the general nature of these models, they can be applied to various types of data including images [7] , video [8] , and audio [9]. Winata, G.