OpenTelemetry Demo with Azure Databricks and Azure Monitor

Monitoring Databricks using Prometheus, Grafana and Pyroscope

This repository provides a complete data observability prototype built on Databricks. It covers schema evolution tracking, data volume & distribution, pipeline freshness monitoring, and lineage visualization for Delta Lake tables.

Framework for observability and data quality management in Databricks

No description available

Agentic AI solution for exploring and reasoning over Databricks using Azure AI Foundry, Semantic Kernel, OpenAPI, and MCP with full observability and orchestration support.

An end-to-end Analytics Engineering system built on Databricks and dbt. Features automated data synthesis, Survival Analysis (Kaplan-Meier) via dbt-Python, and rigorous observability using Monte Carlo and Great Expectations to track the lifecycle of B2B subscription cohorts. #dbt #databricks #pyspark #unit-economics #survival-analysis #ltv #airflow

In this tech hub, I am going to integrate Databricks Unity Catalog data with the DataHub platform. DataHub is a modern data catalog built to enable end-to-end data discovery, data observability, and data governance.

This repository is a structured learning hub for agentic AI systems and GenAI engineering. It includes notes, playground experiments, end-to-end projects, and production patterns covering LangChain, LangGraph, RAG, MCP tools, observability, testing/evals, and cloud integrations (Azure AI, AWS Bedrock, Databricks, vector DBs).

Contains Databricks notebooks to facilitate data observability dashboards for the CDC data-exchange (DEX).

tableau-databricks-observability

airflow-databricks-observability-poc

ADF + Databricks + Delta Lake + CI/CD + Observability

Databricks Audit & Observability Dashboard - deployable via DABs

This repository contains python and pyspark code that can be used to collect and persist delta table metadata for data observability initatives.

No description available

modelo de observabilidade Databricks com SLIs/SLOs medindo confiabilidade, latência e custo, exportando métricas para Prometheus e visualizando em Grafana

🚀 Monitor and enhance the reliability, performance, and cost of Databricks jobs and clusters using Prometheus, Grafana, and Alertmanager.

A suite of Databricks notebooks providing Unity Catalog observability across cost, data quality, lineage, streaming performance, and custom logging.

No description available

Enterprise AI Agent Toolkit — LangGraph agents on Databricks with MLflow 3 observability

Streamlit-based Databricks App for monitoring job run times, trends, and identifying slow jobs

No description available

SilentPulse integrations for Databricks - observability decorators for SDP, Spark data source, UC auto-discovery

Databricks DQ pipeline with OpenTelemetry observability, deployed via Terragrunt on AWS with Grafana Cloud

End-to-end transaction processing & observability platform using Azure, Fabric, Databricks, and Power BI

Context-preserving log pipeline for ML-driven observability using Apache Spark and Delta Lake. DS-610 Big Data Analytics project.

Real-time observability dashboard for SDP-Meta (DLT-Meta) pipelines, deployed as a Databricks App

A production-grade security, compliance & observability platform for e-commerce — built on Azure, Databricks, Kafka, and Kubernetes.

In this tech hub, we are integrating Databricks with the datahub platform for data observability, governance, etc.