Skip to content

DBT: Alerts Dbt Source Freshness

DBT model name: alerts_dbt_source_freshness

Explore dependencies/lineage: link

Description

No description

Details

Column Type Description

No data tests defined 🧐

Not referenced by any model or exposure.

Models

Macros

  • edr_cast_as_timestamp
  • escape_reserved_keywords
  • render_bool_config_var

No called script or script source not found.

{{ config(materialized="view", bind=False) }}

with
    results as (select * from {{ ref("dbt_source_freshness_results") }}),

    sources as (select * from {{ ref("dbt_sources") }})

select
    results.source_freshness_execution_id as alert_id,
    results.max_loaded_at,
    results.snapshotted_at,
    {{ elementary.edr_cast_as_timestamp("results.generated_at") }} as detected_at,
    results.max_loaded_at_time_ago_in_s,
    results.status,
    results.error,
    results.warn_after,
    results.error_after,
    results.{{ elementary.escape_reserved_keywords("filter") }},
    sources.unique_id,
    sources.database_name,
    sources.schema_name,
    sources.source_name,
    sources.identifier,
    sources.tags,
    sources.meta,
    sources.owner,
    sources.package_name,
    sources.path,
    -- These columns below are deprecated. We add them since this view
    -- was used to be loaded into an incremental model with those columns, their names
    -- were later changed
    -- and Databricks doesn't respect `on_schema_change = 'append_new_columns'`
    -- properly, as described here -
    -- https://docs.databricks.com/en/delta/update-schema.html#automatic-schema-evolution-for-delta-lake-merge
    results.error_after as freshness_error_after,
    results.warn_after as freshness_warn_after,
    results.{{ elementary.escape_reserved_keywords("filter") }} as freshness_filter
from results
join sources on results.unique_id = sources.unique_id
where
    {{
        elementary.render_bool_config_var(
            "disable_source_freshness_alerts", negate=true
        )
    }} and lower(status) != 'pass'