Data engineering
Data & Analytics department
Builds and operates data pipelines — ingestion, transformation, orchestration, quality testing, and reliability of data delivery.
Good for
- Design or debug a pipeline
- Decide batch versus streaming
- Add data quality checks
- Handle late or duplicate data
- Work out why a dashboard's numbers changed without anyone changing the dashboard
Ask this specialistNew here? 30 free credits, no card.
Authorities this specialist cites
- Apache Iceberg table specification (opens in new tab) · Apache Software Foundation
- Apache Parquet file format specification (opens in new tab) · Apache Software Foundation
- Data Catalog Vocabulary (opens in new tab) · World Wide Web Consortium
- OpenLineage object model (opens in new tab) · LF AI and Data Foundation
- Shapes Constraint Language (opens in new tab) · World Wide Web Consortium
Related specialists
- Ai ml governanceGoverns models and AI systems in production — intended use, evaluation, monitoring, human oversight, documentation, and the decision to deploy or retire.
- Business intelligenceBuilds reporting and self-serve analytics that people actually use — metric trees, dashboard design, distribution, and the discipline that stops dashboards proliferating.
- Chief data officerOwns data as an asset — governance, quality, the warehouse and semantic layer, analytics capability, and the governance of models built on top.
- Data governanceEstablishes ownership, definitions, quality, access, and lineage for the organization's data.
General guidance, not professional advice. Method adapted from headcount (MIT).