IBM Journey to AI blog

AUGUST 23, 2023

If you add in IBM data governance solutions, the top left will look a bit more like this: The data governance solution powered by IBM Knowledge Catalog offers several capabilities to help facilitate advanced data discovery, automated data quality and data protection.

Large Language Models 167

Large Language Models Data Discovery LLM AI 167

Marktechpost

APRIL 19, 2024

The platform’s distinctive and adaptable design makes connecting and organizing data across any cloud storage option possible. As a result, data silos are eliminated and procedures are streamlined. Key Features When it comes to artificial intelligence, old-fashioned data management technologies can’t keep up.

Artificial Intelligence 106

Artificial Intelligence Artificial Intelligence Data Discovery Automation 106

IBM Journey to AI blog

APRIL 20, 2023

This trust depends on an understanding of the data that inform risk models: where does it come from, where is it being used, and what are the ripple effects of a change?

ETL 217

ETL Data Discovery Automation Metadata 217

IBM Journey to AI blog

OCTOBER 17, 2024

AI-powered features in Cognos Analytics today IBM has embedded AI throughout Cognos Analytics to streamline processes, enhance data discovery and enable users to gain deeper insights with minimal effort. These capabilities lend themselves to a vision for the next generation of BI, powered by IBM® Granite™ foundation models.

Data Discovery 146

Data Discovery Business Intelligence Automation Explainability 146

IBM Journey to AI blog

MAY 9, 2023

Further development of watsonx.data will also incorporate IBM’s Storage Fusion technology to enhance data caching across remote sources as well as semantic automation capabilities built on IBM Research’s foundation models to automate data discovery, exploration, and enrichment through conversational user experiences.

Data Platform 230

Data Platform Business Intelligence Data Discovery AI 230

IBM Journey to AI blog

MAY 23, 2023

” AI automation tools can facilitate more efficient evaluation and review procedures, perform sensitive data discoveries and support monitoring. . “Chasing after compliance regulations and spending all your energy to check off boxes is not the best way to use your cyber talent.”

Automation 262

Automation Data Discovery Machine Learning AI Automation 262

IBM Journey to AI blog

DECEMBER 16, 2022

An enterprise data catalog does all that a library inventory system does – namely streamlining data discovery and access across data sources – and a lot more. For example, data catalogs have evolved to deliver governance capabilities like managing data quality and data privacy and compliance.

Metadata 130

Metadata Data Quality Data Discovery Data Scientist 130

IBM Journey to AI blog

AUGUST 6, 2024

Rethink data protection in the gen AI era With the scale and use scenarios of data in gen AI solutions, organizations must rethink their data lifecycle and how to protect it at scale, in all its states. Think about securing training data by protecting it from theft and manipulation.

AI 213

AI AI Data Discovery Generative AI 213

IBM Journey to AI blog

JANUARY 18, 2023

For example, a bank may get rid of its decade old datawarehouse and deliver all BI and AI use cases from a single data platform, by implementing a lakehouse. Address data complexity with a data fabric architecture. Along with existing data platform nodes, one or multiple lakehouse nodes may also participate there.

Data Platform 130

Data Platform ETL Metadata Data Discovery 130

Flipboard

OCTOBER 25, 2023

The first is the raw input data that gets ingested by source systems, the second is the output data that gets extracted from input data using AI, and the third is the metadata layer that maintains a relationship between them for data discovery.

ML 165

ML Metadata Data Extraction AI 165

Marktechpost

MARCH 22, 2024

DATALORE uses Large Language Models (LLMs) to reduce semantic ambiguity and manual work as a data transformation synthesis tool. Second, for each provided base table T, the researchers use data discovery algorithms to find possible related candidate tables. These models have been trained on billions of lines of code.

Machine Learning 135

Machine Learning Explainability Categorization ETL 135

Marktechpost

MARCH 12, 2024

Even among datasets that include the same subject matter, there is no standard layout of files or data formats. This obstacle lowers productivity through machine learning development—from data discovery to model training. Additionally, it makes it harder to create essential tools for dealing with huge datasets.

Metadata 118

Metadata Machine Learning ML Data Discovery 118

IBM Journey to AI blog

JANUARY 5, 2023

A well-designed data architecture creates a foundation for data quality through transparency and standardization that frames how your organization views, uses and talks about data. As previously mentioned, a data fabric is one such architecture.

Data Quality 130

Data Quality Metadata Big Data ETL 130

IBM Journey to AI blog

JULY 3, 2024

With a semantic layer, you can generate data enrichments that enable clients to find and understand previously cryptic, effectively structured data across your data estate in natural language through semantic search to accelerate data discovery and unlock data insights faster, no SQL required.

Data Quality 112

Data Quality Metadata Business Intelligence AI 112

AWS Machine Learning Blog

AUGUST 22, 2024

Conclusion The incorporation of generative AI into Discovery Navigator underscores Verisk’s commitment to using cutting-edge technologies to drive operational efficiencies and enhance outcomes for its clients in the insurance industry.

Generative AI 115

Generative AI Auto-complete Software Development Automation 115

Attivio

JUNE 8, 2015

June 8, 2015: Attivio ( www.attivio.com ), the Data Dexterity Company, today announced Attivio 5, the next generation of its software platform. Newton, Mass., Attivio 5 will be made available for evaluation the following day, Wednesday, June 10.

Business Intelligence 40

Business Intelligence Big Data Data Discovery Data Scientist 40

DataRobot Blog

APRIL 1, 2018

In Rita Sallam’s July 27 research, Augmented Analytics , she writes that “the rise of self-service visual-bases data discovery stimulated the first wave of transition from centrally provisioned traditional BI to decentralized data discovery.” We agree with that.

Data Discovery 40

Data Discovery Data Integration Machine Learning Data Quality 40

Google Research AI blog

FEBRUARY 28, 2023

In the scientific community and throughout various levels of the public sector, reproducibility and transparency are essential for progress, so sharing data is vital.

Metadata 116

Metadata Software Engineer Data Discovery 116

Pickl AI

OCTOBER 14, 2024

Clustering: Grouping similar data points to identify segments within the data. Applications EDA is widely employed in research and data discovery across industries. Researchers use EDA to better understand their data before conducting more formal statistical analyses.

Data Analysis 52

Data Analysis Data Mining Data Discovery Machine Learning 52

ODSC - Open Data Science

OCTOBER 25, 2024

Delphina Demo: AI-powered Data Scientist Jeremy Hermann | Co-founder at Delphina | Delphina.Ai In this demo, you’ll see how Delphina’s AI-powered “junior” data scientist can transform the data science workflow, automating labor-intensive tasks like data discovery, transformation, and model building.

Data Scientist 52

Data Scientist Software Engineer Automation Machine Learning 52

ODSC - Open Data Science

JULY 20, 2023

In a blog post by Snowflake co-founder Benoit Dagevill, he acknowledged that the goal of this addon will be to use generative AI and other AI-based tools to allow their users to query data in new ways to help them with data discovery.

Machine Learning 52

Machine Learning Data Science Neural Network Automation 52

ODSC - Open Data Science

JUNE 2, 2023

Get Answers as Fast as the World Produces Data With Visual Analytics on SAS Viya, you’ll have data discovery and exploration with interactive reporting all from a single application. Keeping all stakeholders informed and involved to make the most informed next action is paramount.

Business Intelligence 52

Business Intelligence Data Science Composite AI Automation 52

ODSC - Open Data Science

FEBRUARY 13, 2024

Data discovery, mapping, classification, incident response, and remediation are ongoing. With the automated remediation that DSPM offers, access policies can be tweaked to adhere to zero trust methodology. This reduces the chance of misusing stolen credentials to gain illicit access. DSPM has to be a continuous process.

Data Science 52

Data Science Data Discovery Machine Learning Automation 52

The MLOps Blog

MAY 17, 2023

Each subsystem is essential, and sequentially, each sub-system feeds into the next until data reaches its destination. ETL data pipeline architecture | Source: Author Data Discovery: Data can be sourced from various types of systems, such as databases, file systems, APIs, or streaming sources.

ETL 59

ETL ML Machine Learning Data Scientist 59

Marktechpost

JULY 19, 2023

There are two main zeno frontend views: the Exploration UI, which is used for data discovery and slice creation, and the Analysis UI, which is used for test creation, report creation, and performance monitoring. The API’s outputs are a framework to build the main interface for conducting behavioral evaluation and testing.

Machine Learning 52

Machine Learning ML Python Metadata 52

Pickl AI

JUNE 13, 2024

Tools and Technologies for Data Classification: Aiding the Process This can be complex and time-consuming, especially for large organizations with vast amounts of data. To create a comprehensive data inventory, they can scan network drives, cloud storage repositories, and even employee devices.

Categorization 52

Categorization Automation Data Discovery Algorithm 52

Pickl AI

JULY 25, 2024

AWS Glue A fully managed ETL service that makes it easy to prepare and load data for analytics. It automates the process of data discovery, transformation, and loading. These tools streamline the process, allowing organisations to focus on analysing the data rather than managing the ingestion itself.

Data Ingestion 52

Data Ingestion ETL Data Quality Data Integration 52

Pickl AI

JUNE 11, 2024

However, use colour judiciously, considering colour blindness and ensuring colour choices effectively represent the data. Interactivity Enhances Engagement Explore interactive visualizations that allow users to explore the data themselves. This can foster deeper understanding and promote data discovery.

Data Analysis 52

Data Analysis Categorization Data Science Data Discovery 52

Pickl AI

JULY 6, 2023

Utilizing Hive in Hadoop: Use Cases and Benefits Hive is widely used in big data analytics for various use cases, including: Data Exploration Hive allows users to interactively explore and analyze large datasets stored in Hadoop, enabling data discovery and gaining valuable insights.

Big Data 52

Big Data Data Analysis ETL Metadata 52

Heartbeat

DECEMBER 21, 2023

Uncovering the Power of Comet Across the Data Science Journey Photo by Nguyen Le Viet Anh on Unsplash Machine learning (ML) projects are usually complicated and include several stages, from data discovery to model implementation. Comet is a robust platform that provides comprehensive functionality to streamline these stages.

ML 52

ML Machine Learning Deep Learning Neural Network 52

Marktechpost

JULY 18, 2023

An online SQL client, a cloud data backup tool, and an OData server-as-a-service option are also included. Voracity supports hundreds of data sources and immediately feeds BI and visualization targets as a “production analytic platform.”

ETL 52

ETL Data Integration Business Intelligence Automation 52

Pickl AI

OCTOBER 10, 2023

In this blog, we are going to unfold the two key aspects of data management that is Data Observability and Data Quality. Data is the lifeblood of the digital age. Today, every organization tries to explore the significant aspects of data and its applications.

Data Quality 52

Data Quality Machine Learning Data Science Data Integration 52

Snorkel AI

JULY 5, 2023

Generally, data is produced by one team, and then for that to be discoverable and useful for another team, it can be a daunting task for most organizations. Even larger, more established organizations struggle with data discovery and usage.

Large Language Models 52

Large Language Models Metadata Machine Learning AI 52

Snorkel AI

JULY 5, 2023

Generally, data is produced by one team, and then for that to be discoverable and useful for another team, it can be a daunting task for most organizations. Even larger, more established organizations struggle with data discovery and usage.

Large Language Models 52

Large Language Models Metadata Machine Learning AI 52

Snorkel AI

JULY 5, 2023

Generally, data is produced by one team, and then for that to be discoverable and useful for another team, it can be a daunting task for most organizations. Even larger, more established organizations struggle with data discovery and usage.

Large Language Models 52

Large Language Models Metadata Machine Learning AI 52

ML @ CMU

MARCH 24, 2023

Algorithmic methods that find clusters of data with high error have also shown promise for surfacing problematic behaviors. Data discovery and generation. Having high-quality, representative data remains a persistent obstacle for behavioral evaluation.

AI Development 144

AI Development AI Developer Metadata AI 144

AWS Machine Learning Blog

MAY 31, 2024

You can also use custom data identifiers to create data identifiers tailored to your specific use case. Data discovery and findability Findability is an important step of the process. Organizations need to have mechanisms to find the data under consideration in an efficient and quick manner for timely response.

Generative AI 130

Generative AI Machine Learning Artificial Intelligence Artificial Intelligence 130