Remove 2016 Remove Convolutional Neural Networks Remove NLP
article thumbnail

Embed, encode, attend, predict: The new deep learning formula for state-of-the-art NLP models

Explosion

Most NLP problems can be reduced to machine learning problems that take one or more texts as input. However, most NLP problems require understanding of longer spans of text, not just individual words. This has always been a huge weakness of NLP models. 2016) presented a model that achieved 86.8% Now we have a solution.

article thumbnail

ML and NLP Research Highlights of 2020

Sebastian Ruder

The selection of areas and methods is heavily influenced by my own interests; the selected topics are biased towards representation and transfer learning and towards natural language processing (NLP). This is less of a problem in NLP where unsupervised pre-training involves classification over thousands of word types.

NLP 52
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Foundation models: a guide

Snorkel AI

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks Radford et al. 2016) This paper introduced DCGANs, a type of generative model that uses convolutional neural networks to generate images with high fidelity. Attention Is All You Need Vaswani et al.

BERT 83
article thumbnail

Multi-Modal Methods: Image Captioning (From Translation to Attention)

ML Review

Recent Intersections Between Computer Vision and Natural Language Processing (Part Two) This is the second instalment of our latest publication series looking at some of the intersections between Computer Vision (CV) and Natural Language Processing (NLP). The complete set of generated words is the output sequence (or sentence) of the network.

article thumbnail

Mastering Visual Question Answering with Deep Learning and Natural Language Processing: A Pocket-friendly Guide

John Snow Labs

Visual question answering (VQA), an area that intersects the fields of Deep Learning, Natural Language Processing (NLP) and Computer Vision (CV) is garnering a lot of interest in research circles. NLP is a particularly crucial element of the multi-discipline research problem that is VQA. is an object detection task.

article thumbnail

Dude, Where’s My Neural Net? An Informal and Slightly Personal History

Lexalytics

I was out of the neural net biz. Fast-forward a couple of decades: I was (and still am) working at Lexalytics, a text-analytics company that has a comprehensive NLP stack developed over many years. The CNN was a 6-layer neural net with 132 convolution kernels and (don’t laugh!) Hinton (again!) and BERT.

article thumbnail

sense2vec reloaded: contextually-keyed word vectors

Explosion

In 2016 we trained a sense2vec model on the 2015 portion of the Reddit comments corpus, leading to a useful library and one of our most popular demos. from_disk("/path/to/s2v_reddit_2015_md") nlp.add_pipe(s2v) doc = nlp("A sentence about natural language processing.") That work is now due for an update. assert doc[3:6].text

NLP 52