Unite.AI

JUNE 4, 2024

Although migration work is a key component of our business, it’s the data platform engagements that really stand out when you’re talking about value to the business. This led to inconsistent data standards and made it difficult for them to gain actionable insights. The impact of these efforts was transformative.

Data Ingestion 130

Data Ingestion Data Platform Machine Learning Generative AI 130

Unite.AI

OCTOBER 14, 2024

Oftentimes, this requires implementing a “hot” part of the initial data ingest, or landing zone where applications and users can work as fast as possible. How does Quantum plan to stay ahead in the rapidly evolving AI and data management landscape? In today’s world, being merely a “storage provider” is not enough.

ML 195

ML Data Ingestion Data Analysis Machine Learning 195

AWS Machine Learning Blog

NOVEMBER 15, 2023

The teams built a new data ingestion mechanism, allowing the CTR files to be jointly delivered with the audio file to an S3 bucket. Principal and AWS collaborated on a new AWS Lambda function that was added to the Step Functions workflow.

Data Ingestion 122

Data Ingestion Metadata NLP Data Scientist 122

IBM Journey to AI blog

SEPTEMBER 20, 2023

These include data ingestion, data selection, data pre-processing, FM pre-training, model tuning to one or more downstream tasks, inference serving, and data and AI model governance and lifecycle management—all of which can be described as FMOps. IBM watsonx consists of the following: IBM watsonx.ai

Large Language Models 240

Large Language Models DevOps AI Modeling Automation 240

AWS Machine Learning Blog

FEBRUARY 27, 2024

Axfood has a structure with multiple decentralized data science teams with different areas of responsibility. Together with a central data platform team, the data science teams bring innovation and digital transformation through AI and ML solutions to the organization.

Machine Learning 126

Machine Learning DevOps Data Scientist Data Quality 126

AWS Machine Learning Blog

DECEMBER 18, 2023

In this post, we will explore the potential of using MongoDB’s time series data and SageMaker Canvas as a comprehensive solution. MongoDB Atlas MongoDB Atlas is a fully managed developer data platform that simplifies the deployment and scaling of MongoDB databases in the cloud.

Data Extraction 119

Data Extraction Data Ingestion ML Machine Learning 119

Pickl AI

OCTOBER 10, 2024

Its drag-and-drop interface makes it user-friendly, allowing data engineers to build complex workflows without extensive coding knowledge. Nifi excels in data ingestion, routing, transformation, and system-to-system data flow management.

ETL 52

ETL Data Quality Business Intelligence Big Data 52

The MLOps Blog

JANUARY 26, 2024

Keeping track of how exactly the incoming data (the feature pipeline’s input) has to be transformed and ensuring that each model receives the features precisely how it saw them during training is one of the hardest parts of architecting ML systems. This is where feature stores come in. What is a feature store?

Machine Learning 72

Machine Learning Metadata ML Python 72

Mlearning.ai

FEBRUARY 16, 2023

Arranging Efficient Data Streams Modern companies typically receive data from multiple sources. Therefore, quick data ingestion for instant use can be challenging. Attend Snowflake University Snowflake has an online university that aims to educate users with all levels of expertise through a variety of courses.

Business Intelligence 52

Business Intelligence Data Ingestion Metadata Machine Learning 52

Pickl AI

JUNE 29, 2023

Advantages of Using Splunk Real-time Visibility One of the significant advantages of Splunk is its ability to provide real-time data visibility. Thus, it lets users gain insights from vast data in real time. Additionally, it also supports a host of data formats. Thereby enabling faster decision-making and problem-solving.

Big Data 52

Big Data DevOps Data Analysis Machine Learning 52

The MLOps Blog

MARCH 15, 2023

A typical data pipeline involves the following steps or processes through which the data passes before being consumed by a downstream process, such as an ML model training process. Data Ingestion : Involves raw data collection from origin and storage using architectures such as batch, streaming or event-driven.

ETL 59

ETL Categorization Automation Data Integration 59

ODSC - Open Data Science

SEPTEMBER 29, 2023

Arjuna Chala, associate vice president, HPCC Systems For those not familiar with the HPCC Systems data lake platform, can you describe your organization and the development history behind HPCC Systems? They were interested in creating a data platform capable of managing a sizable number of datasets.

Big Data 52

Big Data ETL Data Science Data Ingestion 52

AWS Machine Learning Blog

MARCH 29, 2023

Data ingestion HAYAT HOLDING has a state-of-the art infrastructure for acquiring, recording, analyzing, and processing measurement data. Two types of data sources exist for this use case. HAYAT KIMYA integrated the ML solution in one of its plants.

ML 79

ML Machine Learning Algorithm Data Scientist 79

ODSC - Open Data Science

JULY 19, 2023

Data Estate: This element represents the organizational data estate, potential data sources, and targets for a data science project. Data Engineers would be the primary owners of this element of the MLOps v2 lifecycle. The Azure data platforms in this diagram are neither exhaustive nor prescriptive.

Machine Learning 52

Machine Learning Data Drift Data Science Data Scientist 52

The MLOps Blog

MARCH 12, 2024

Tools range from data platforms to vector databases, embedding providers, fine-tuning platforms, prompt engineering, evaluation tools, orchestration frameworks, observability platforms, and LLM API gateways. Develop the text preprocessing pipeline Data ingestion: Use Unstructured.io

Prompt Engineer 52

Prompt Engineer Prompt Engineering Large Language Models LLM 52

TransOrg Analytics

SEPTEMBER 24, 2024

Snowflake Data Engineering Solutions Maximize the potential of your data with Snowflake’s data cloud. Our services harness Snowflake’s powerful features to architect, build, and manage a modern data platform. Secure Data Sharing: Share data securely within and across organizations.

ETL 52

ETL Data Ingestion LLM Automation 52

Bugra Akyildiz

FEBRUARY 24, 2024

Streaming data platforms: Apache Kafka and Apache Flink enable real-time ingestion and processing of user actions, clickstream data, and product catalogs, feeding fresh data to the models.

Large Language Models 52

Large Language Models LLM Data Ingestion Neural Network 52

The MLOps Blog

MARCH 21, 2023

They work with other users to make sure the data reflects the business problem, the experimentation process is good enough for the business, and the results reflect what would be valuable to the business. What do they want to accomplish?

Machine Learning 69

Machine Learning Data Scientist ML Metadata 69