Reusable, pipeline-agnostic data quality framework built on PySpark. Plug into any Databricks notebook, AWS Glue job, or dbt post-hook. All thresholds are driven by YAML config — zero hardcoded values ...
Data work in 2026 asks for more than chart building. Professionals are expected to clean data, query databases, explain trends, and present findings clearly across business, finance, product, and ...