DataLineage Doctor

RCA dashboard

Incident detail

dbt.default.stg_products

Triggered at 26-04-2026 20:39

COMPLETE HIGH confidence

Root cause summary

The freshness_check_products test on dbt.default.stg_products aborted because the upstream transformation pipeline airflow.dbt_transform_daily failed on its run_fct task since 2026-04-20T03:00:00Z. This prevented the dbt.default.stg_products table from being updated, leading to stale data.

0.95 Score

Evidence chain

  1. The freshness_check_products test on dbt.default.stg_products aborted at 2026-04-26T15:09:55.517000+00:00.
  2. Multiple other data quality tests, including dbt.default.default.fct_revenue.freshness_check on dbt.default.default.fct_revenue, also aborted around 2026-04-26T15:09:58Z, indicating a broader upstream data update issue.
  3. The upstream pipeline airflow.dbt_transform_daily, which is responsible for updating dbt.default.stg_products, has a Failed status.
  4. The airflow.dbt_transform_daily pipeline last ran and failed on 2026-04-20T03:00:00Z, specifically its run_fct task, preventing subsequent updates to dbt.default.stg_products.
  5. The ingestion pipeline airflow.ingest_products_daily is Successful, indicating the issue is not with raw data ingestion into mysql.default.default.raw_products.
  6. Past incidents (e.g., incident_id: 807ca969-5e06-42a6-91ba-3fea6cf8f092 and f54a027c-a5f5-487d-99c2-908d655b7131) for dbt.default.stg_products show similar freshness_check_products failures attributed to airflow.dbt_transform_daily failures, corroborating the current root cause.

Remediation steps

  1. Investigate and fix the Failed task run_fct within the airflow.dbt_transform_daily pipeline.
  2. Rerun the airflow.dbt_transform_daily pipeline to ensure dbt.default.stg_products is updated with fresh data.
  3. Monitor the freshness_check_products test on dbt.default.stg_products for successful completion after the pipeline run.

Lineage graph

Root cause highlighted in red. Downstream impacts in amber.

Timeline

  • pipeline_failure
    20-04-2026 08:30 · airflow.dbt_transform_daily

    The airflow.dbt_transform_daily pipeline task run_fct failed, leading to the pipeline's overall Failed status and preventing updates to dbt.default.stg_products.

  • data_quality_test_triggered
    26-04-2026 20:39 · dbt.default.stg_products

    The freshness_check_products test was triggered on dbt.default.stg_products.

  • data_quality_test_failed
    26-04-2026 20:39 · dbt.default.default.stg_products.freshness_check_products

    The freshness_check_products test on dbt.default.stg_products resulted in Aborted due to stale data.

  • data_quality_test_failed
    26-04-2026 20:39 · dbt.default.default.fct_revenue.freshness_check

    The freshness_check_products test on dbt.default.default.fct_revenue also resulted in Aborted, indicating downstream impact.

Blast radius

Level 1

Entity Type Service
dbt.default.default.fct_revenue T table dbt