Event Registration - Higher Education Data World
This event has completed.
3:30 PM - 5:00 PM EST
HEDW Webinar - Open Source Metadata Management with LLMs
12/12/2024 - 12/12/20243:30 PM - 5:00 PM EST
Event Description
In today's data-driven enterprises, effective metadata management is crucial for maintaining data quality, governance, and accessibility. However, many organizations, particularly those working with legacy systems, struggle to find cost-effective solutions for documenting their data assets, tracking lineage, and maintaining business glossaries.
This talk presents a practical approach to metadata management that combines the power of Large Language Models (LLMs) with open-source tools. We'll demonstrate how to build a comprehensive metadata management solution that doesn't break the bank while meeting modern data documentation needs.
Technologies Discussed:
Anthropic Claude3.5 Models hosted via AWS Bedrock
Langchain: An open-source python/JS library for interacting with LLMs
dbt-core: An open-source python library for building data transformation pipelines and documentation
Presenter: Logan Lossing, Cal Poly
This talk presents a practical approach to metadata management that combines the power of Large Language Models (LLMs) with open-source tools. We'll demonstrate how to build a comprehensive metadata management solution that doesn't break the bank while meeting modern data documentation needs.
Technologies Discussed:
Anthropic Claude3.5 Models hosted via AWS Bedrock
Langchain: An open-source python/JS library for interacting with LLMs
dbt-core: An open-source python library for building data transformation pipelines and documentation
Presenter: Logan Lossing, Cal Poly