Skip to content

DBT: S3 Dbt Documented Files

DBT model name: s3_dbt_documented_files

Explore dependencies/lineage: link

Description

dbt models writing to a known S3 location, with their wiki data-catalog URL and description (from Elementary's dbt_models metadata). Small detail table (a few hundred → few thousand rows) joined on demand to s3_files_latest.

Details

Column Type Description

No data tests defined 🧐

Models

Models

No called script or script source not found.

{{ config(materialized='table', tags=['s3_inventory']) }}

-- dbt models that write to a known S3 location, with a link to their page in the
-- wiki data catalog. Sourced from Elementary's captured dbt metadata
-- (main_elementary.dbt_models). Joined to s3_files_latest in s3_files_enriched so
-- each monitored file can show whether it has dbt documentation.

select
    name,
    'https://wiki.deforestationfree.com/dbt_data_catalog/'
        || regexp_replace(path, '\.[^.]+$', '') as catalog_url,
    json_extract_string(meta, '$.s3_location') as s3_location,
    description,
    generated_at
from {{ ref('dbt_models') }}
where json_extract_string(meta, '$.s3_location') is not null