Sebastian Ruder

FEBRUARY 23, 2023

This post gives a brief overview of modularity in deep learning. Fuelled by scaling laws, state-of-the-art models in machine learning have been growing larger and larger. We give an in-depth overview of modularity in our survey on Modular Deep Learning. Case studies of modular deep learning.

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

AWS Machine Learning Blog

MARCH 2, 2023

Hyperparameter optimization is highly computationally demanding for deep learning models. Conclusion In this post, we showed how to use an EKS cluster with Weights & Biases to accelerate hyperparameter grid search for deep learning models. script exists in a Docker image that copies data from Amazon S3 to Amazon EFS.

BERT 83

BERT Deep Learning Metadata Auto-complete 83

Topbots

JUNE 15, 2023

70% of research papers published in a computational linguistics conference only evaluated English.[ I additionally use metadata from The World Atlas of Language Structures to obtain information such as language family (e.g. Association for Computational Linguistics. Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Marek Rei

NOVEMBER 4, 2024

Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease Veronika Vincze, Martina Katalin Szabó, Ildikó Hoffmann, László Tóth, Magdolna Pákáski, János Kálmán, Gábor Gosztolya. Computational Linguistics 2022. Additive embeddings are used for representing metadata about each note.

Machine Learning 80

Machine Learning NLP Large Language Models LLM 80

Sebastian Ruder

NOVEMBER 14, 2022

This post is partially based on a keynote I gave at the Deep Learning Indaba 2022. These include groups focusing on linguistic regions such as Masakhane for African languages, AmericasNLP for native American languages, IndoNLP for Indonesian languages, GhanaNLP and HausaNLP , among others. Lucassen, T., 2340–2354).

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics BERT 52