AWS Machine Learning Blog

JUNE 26, 2024

Artificial intelligence and machine learning (AI/ML) technologies can assist capital market organizations overcome these challenges. Intelligent document processing (IDP) applies AI/ML techniques to automate data extraction from documents. Sovik Kumar Nath is an AI/ML solution architect with AWS.

Automation 108

Automation IDP ML AI 108

ODSC - Open Data Science

OCTOBER 27, 2023

With Intelligent Document Processing (IDP) leveraging artificial intelligence (AI), the task of extracting data from large amounts of documents with differing types and structures becomes efficient and accurate. The following diagram is how we visualize these IDP phases.

IDP 98

IDP LLM Large Language Models Data Science 98

AWS Machine Learning Blog

FEBRUARY 21, 2025

Rule-based systems or specialized machine learning (ML) models often struggle with the variability of real-world documents, especially when dealing with semi-structured and unstructured data. We demonstrate how generative AI along with external tool use offers a more flexible and adaptable solution to this challenge.

Categorization 83

Categorization IDP Generative AI Automation 83

AWS Machine Learning Blog

MAY 24, 2023

In this three-part series, we present a solution that demonstrates how you can automate detecting document tampering and fraud at scale using AWS AI and machine learning (ML) services for a mortgage underwriting use case. Amazon Fraud Detector is called for a fraud prediction score using the data extracted from the mortgage documents.

Automation 83

Automation Computer Vision Data Extraction IDP 83

Topbots

APRIL 4, 2024

Switching from the old-school combo of OCR and basic NLP to the smarter duo of Intelligent Document Processing (IDP) and Large Language Models (LLMs) makes handling documents a breeze. IDP steps up the game. It’s smarter because it uses a mix of tech, including advanced machine learning and NLP, to see the big picture.

Automation 59

Automation IDP NLP Natural Language Processing 59

AWS Machine Learning Blog

JUNE 12, 2024

By using the advanced natural language processing (NLP) capabilities of Anthropic Claude 3 Haiku, our intelligent document processing (IDP) solution can extract valuable data directly from images, eliminating the need for complex postprocessing. As next steps, check out What is Amazon Bedrock to start using the service.

IDP 125

IDP NLP Natural Language Processing Generative AI 125

AWS Machine Learning Blog

MARCH 29, 2023

In this post, we discuss how the IEO developed UNDP’s artificial intelligence and machine learning (ML) platform—named Artificial Intelligence for Development Analytics (AIDA)— in collaboration with AWS, UNDP’s Information and Technology Management Team (UNDP ITM), and the United Nations International Computing Centre (UNICC).

ML 83

ML Metadata Data Ingestion Data Extraction 83

AWS Machine Learning Blog

NOVEMBER 13, 2024

The market size for multilingual content extraction and the gathering of relevant insights from unstructured documents (such as images, forms, and receipts) for information processing is rapidly increasing. A predefined JSON schema can be provided to the Rhubarb API, which makes sure the LLM generates data in that specific format.

IDP 94

IDP Machine Learning Python ML 94

AWS Machine Learning Blog

OCTOBER 23, 2024

Automate intelligent document processing (IDP) – Agent Creator can extract valuable data from invoices, purchase orders, resumes, insurance claims, loan applications, and other unstructured sources automatically. Dhawal Patel is a Principal Machine Learning Architect at AWS.

Generative AI 77

Generative AI IDP LLM Automation 77

AWS Machine Learning Blog

JULY 18, 2024

Enterprise customers can unlock significant value by harnessing the power of intelligent document processing (IDP) augmented with generative AI. By infusing IDP solutions with generative AI capabilities, organizations can revolutionize their document processing workflows, achieving exceptional levels of automation and reliability.

IDP 127

IDP Generative AI Data Extraction Automation 127

AWS Machine Learning Blog

DECEMBER 17, 2024

Developers face significant challenges when using foundation models (FMs) to extract data from unstructured assets. This data extraction process requires carefully identifying models that meet the developers specific accuracy, cost, and feature requirements.

Automation 105

Automation IDP Generative AI Data Extraction 105