Sebastian Ruder

FEBRUARY 23, 2023

d) Hypernetwork: A small separate neural network generates modular parameters conditioned on metadata.  Instead of learning module parameters directly, they can be generated using an auxiliary model (a hypernetwork) conditioned on additional information and metadata. Parameter composition.  We Module parameter generation.  Instead

Deep Learning 52

Deep Learning NLP Computer Vision Metadata 52

Sebastian Ruder

JUNE 6, 2022

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. use an LM to generate relevant knowledge statements in a few-shot setting.

NLP 52

NLP Natural Language Processing Computational Linguistics Neural Network 52

Sebastian Ruder

NOVEMBER 14, 2022

Developing models that work for more languages is important in order to offset the existing language divide and to ensure that speakers of non-English languages are not left behind, among many other reasons. Writing System and Speaker Metadata for 2,800+ Language Varieties. Lucassen, T., 2340–2354).

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics AI 52

Topbots

JUNE 15, 2023

Language Disparity in Natural Language Processing This digital divide in natural language processing (NLP) is an active area of research. 70% of research papers published in a computational linguistics conference only evaluated English.[ Association for Computational Linguistics.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

AWS Machine Learning Blog

MARCH 2, 2023

Ana has had several leadership roles at startups and large corporations such as Intel and eBay, leading ML inference and linguistics related products. Ana has a Masters in Computational Linguistics and an MBA form Haas/UC Berkeley, and and has been a visiting scholar in Linguistics at Stanford.

BERT 75

BERT Deep Learning Metadata Auto-complete 75