Google Research AI blog

FEBRUARY 28, 2023

In 2022, we expanded our research interactions and programs to faculty and students across Latin America , which included grants to women in computer science in Ecuador. See some of the datasets and tools we released in 2022 listed below. We work towards inclusive goals and work across the globe to achieve them.

Robotics 72

Robotics Deep Learning Auto-classification Auto-complete 72

AWS Machine Learning Blog

DECEMBER 4, 2023

An important aspect of our strategy has been the use of SageMaker and AWS Batch to refine pre-trained BERT models for seven different languages. The project was completed in a month and deployed to production after a week of testing. We used GPU jobs that help us run jobs that use an instance’s GPUs.

BERT 119

BERT Auto-complete Data Scientist Machine Learning 119

Unite.AI

AUGUST 1, 2023

In zero-shot learning, no examples of task completion are provided in the model. Chain-of-thought Prompting Chain-of-thought prompting leverages the inherent auto-regressive properties of large language models (LLMs), which excel at predicting the next word in a given sequence. This approach, introduced by Kojima et al.

Prompt Engineering 246

Prompt Engineering Prompt Engineer ChatGPT Convolutional Neural Networks 246

The MLOps Blog

SEPTEMBER 26, 2024

In 2022, when GPT-3.5 Self-attention is the mechanism where tokens interact with each other (auto-regressive) and with the knowledge acquired during pre-training. In extreme cases, certain tokens can completely break an LLM. Hallucinations can be detected by verifying the accuracy and reliability of the model’s responses.

LLM 72

LLM Auto-complete Prompt Engineer Prompt Engineering 72

AWS Machine Learning Blog

APRIL 17, 2023

In 2022, SageMaker Hosting added the support for larger Amazon Elastic Block Store (Amazon EBS) volumes up to 500 GB, longer download timeout up to 60 minutes, and longer container startup time of 60 minutes. A complete example that illustrates the no-code option can be found in the following notebook.

Prompt Engineer 96

Prompt Engineer Prompt Engineering Deep Learning Large Language Models 96

AWS Machine Learning Blog

MARCH 6, 2023

Large language models (LLMs) are neural network-based language models with hundreds of millions ( BERT ) to over a trillion parameters ( MiCS ), and whose size makes single-GPU training impractical. This results in faster restarts and workload completion. Cluster update is currently enabled for P and G GPU-based instance types.

Large Language Models 97

Large Language Models LLM Machine Learning Deep Learning 97

AWS Machine Learning Blog

FEBRUARY 24, 2023

In November 2022, MMEs added support for GPU s, which allows you to run multiple models on a single GPU device and scale GPU instances behind a single endpoint. In addition, load testing can help guide the auto scaling strategies using the right metrics rather than iterative trial and error methods. Diff (%) CV CNN Resnet50 ml.g4dn.2xlarge

BERT 102

BERT NLP Computer Vision Neural Network 102