Sebastian Ruder

JANUARY 19, 2021

2020 ), Turing-NLG , BST ( Roller et al., 2020 ), and GPT-3 ( Brown et al., 2020 ; Fan et al., 2020 ), quantization ( Fan et al., 2020 ), and compression ( Xu et al., 2020 ; Fan et al., 2020 ), quantization ( Fan et al., 2020 ), and compression ( Xu et al., 2020 ) and Big Bird ( Zaheer et al.,

NLP 52

NLP ML Computer Vision Natural Language Processing 52

Mlearning.ai

APRIL 8, 2023

With the rise of deep learning (deep learning means multiple levels of neural networks) and neural networks, models such as Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs) began to be used in NLP. 2020) “GPT-4 Technical report ” by Open AI.

NLP 98

NLP Neural Network Natural Language Processing Convolutional Neural Networks 98

Snorkel AI

MARCH 1, 2023

BERT BERT, an acronym that stands for “Bidirectional Encoder Representations from Transformers,” was one of the first foundation models and pre-dated the term by several years. BERT proved useful in several ways, including quantifying sentiment and predicting the words likely to follow in unfinished sentences.

BERT 83

BERT Natural Language Processing Large Language Models Neural Network 83

Viso.ai

FEBRUARY 25, 2023

Vision Transformer (ViT) have recently emerged as a competitive alternative to Convolutional Neural Networks (CNNs) that are currently state-of-the-art in different image recognition computer vision tasks. No 2018 Oct BERT Pre-trained transformer models started dominating the NLP field.

Convolutional Neural Networks 52

Convolutional Neural Networks Computer Vision Neural Network Natural Language Processing 52

Heartbeat

JUNE 6, 2023

GCNs use a combination of graph-based representations and convolutional neural networks to analyze large amounts of textual data. A GCN consists of multiple layers, each of which applies a graph convolution operation to the input graph. References Paperwithcode | Graph Convolutional Network Kai, S.,

NLP 59

NLP Convolutional Neural Networks Neural Network Natural Language Processing 59

Lexalytics

APRIL 5, 2021

A paper that exemplifies the Classifier Cage Match era is LeCun et al [ 109 ], which pits support vector machines (SVMs), k-nearest neighbor (KNN) classifiers, and convolution neural networks (CNNs) against each other to recognize images from the NORB database. The base model of BERT [ 103 ] had 12 (!) Hinton (again!)

Neural Network 52

Neural Network Convolutional Neural Networks Natural Language Processing BERT 52

ML Review

DECEMBER 16, 2019

NeurIPS’18 presented several papers with deep theoretical studies of building hyperbolic neural nets. Source: Chami et al Chami et al present Hyperbolic Graph Convolutional Neural Networks (HGCN) and Liu et al propose Hyperbolic Graph Neural Networks (HGNN). Thank you for reading!

Machine Learning 52

Machine Learning Neural Network Explainability NLP 52