Remove Computational Linguistics Remove Metadata Remove Neural Network
article thumbnail

Modular Deep Learning

Sebastian Ruder

Computation Function We consider a neural network $f_theta$ as a composition of functions $f_{theta_1} odot f_{theta_2} odot ldots odot f_{theta_l}$, each with their own set of parameters $theta_i$. d) Hypernetwork: A small separate neural network generates modular parameters conditioned on metadata.

article thumbnail

68 Summaries of Machine Learning and NLP Research

Marek Rei

Linguistic Parameters of Spontaneous Speech for Identifying Mild Cognitive Impairment and Alzheimer Disease Veronika Vincze, Martina Katalin Szabó, Ildikó Hoffmann, László Tóth, Magdolna Pákáski, János Kálmán, Gábor Gosztolya. Computational Linguistics 2022. Additive embeddings are used for representing metadata about each note.

article thumbnail

ACL 2022 Highlights

Sebastian Ruder

The initiative focuses on making Computational Linguistics (CL) research accessible in 60 languages and across all modalities, including text/speech/sign language translation, closed captioning, and dubbing. We can also incorporate additional knowledge by modifying the training data, e.g., by inserting metadata strings (e.g.,

NLP 52