Sebastian Ruder

FEBRUARY 23, 2023

This post gives a brief overview of modularity in deep learning. Fuelled by scaling laws, state-of-the-art models in machine learning have been growing larger and larger. We give an in-depth overview of modularity in our survey on Modular Deep Learning. Case studies of modular deep learning.

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

Viso.ai

JULY 18, 2024

Machine learning especially Deep Learning is the backbone of every LLM. Emergence and History of LLMs Artificial Neural Networks (ANNs) and Rule-based Models The foundation of these Computational Linguistics models (CL) dates back to the 1940s when Warren McCulloch and Walter Pitts laid the groundwork for AI.

Large Language Models 52

Large Language Models Neural Network Natural Language Processing BERT 52

NLP People

JUNE 5, 2018

Babbel Based in Berlin and New York, Babbel is a language learning platform, helping one learn a new language on the go. handles most common and repetitive questions in self-learning chat-based customer service. Their products are language-agnostic as they use deep learning in the development of their algorithms.

NLP 52

NLP Data Mining Deep Learning Natural Language Processing 52

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ In Findings of the Association for Computational Linguistics: ACL 2022 , pages 2340–2354, Dublin, Ireland. Association for Computational Linguistics. Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Topbots

JANUARY 30, 2023

In the past, the Deep Learning community solved the data shortage with self-supervision — pre-training LLMs using next-token prediction, a learning signal that is available “for free” since it is inherent to any text. Association for Computational Linguistics. [2] Association for Computational Linguistics. [4]

Large Language Models 52

Large Language Models Computational Linguistics LLM Natural Language Processing 52

The Stanford AI Lab Blog

JANUARY 21, 2022

Deep learning has enabled improvements in the capabilities of robots on a range of problems such as grasping 1 and locomotion 2 in recent years. Deep contextualized word representations. Conference of the North American Chapter of the Association for Computational Linguistics. ↩ Devlin, J., Neumann, M.,

Robotics 40

Robotics Computational Linguistics BERT Computer Vision 40

Sebastian Ruder

NOVEMBER 14, 2022

This post is partially based on a keynote I gave at the Deep Learning Indaba 2022. These include groups focusing on linguistic regions such as Masakhane for African languages, AmericasNLP for native American languages, IndoNLP for Indonesian languages, GhanaNLP and HausaNLP , among others. Vulić, I., & Søgaard, A.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52