Skip to content

DBT: Gold Ethiopia Coffee 2020

File location: s3://trase-storage/ethiopia/trade/bol/2020/gold/gold_ethiopia_coffee_2020.parquet

DBT model name: gold_ethiopia_coffee_2020

Explore on Metabase: Full table; summary statistics

Explore dependencies/lineage: link

Description

Pre-processing done initially through an R script called by silver_ethiopia_coffee_2020 which * Loads the vendor excel file * Cleans the country names * Fixes 3 outliers based on exchange rate, and a record without FOB * Checks against comtrade in total, and per country

Then a python file called by gold_ethiopia_coffee_2020: * Cleans additional country names, using as reference the database * Gets the related trader information from the database * Note that a runbook ingested the missing traders

Details

Column Type Description
year INTEGER
exporter_label VARCHAR
exporter_node_id INTEGER
exporter_group_name VARCHAR
country_of_destination VARCHAR
mass_tonnes DOUBLE
fob DOUBLE
importer_label VARCHAR
port_of_export_label VARCHAR
hs6 VARCHAR

Review full report including sample errors records if they exist (link)

Test column Test name Failing rows Last test run Last status Query in Metabase
Whole table test check_bol_against_comtrade_gold_ethiopia_coffee_2020_ETH__0901_2101__mass_tonnes__2020 — 2026-07-07 15:08 pass 🔍 run query
Whole table test check_trader_groups_gold_ethiopia_coffee_2020_exporter_group_name__2020 — 2026-07-07 15:09 pass 🔍 run query
country_of_destination relationships_gold_ethiopia_coffee_2020_country_of_destination__country_name__ref_postgres_countries_ — 2026-07-07 15:14 pass 🔍 run query

Models

Models

No called script or script source not found.

# gold_ethiopia_coffee_2020
from trase.data.ethiopia.trade.bol.y2020.gold import gold_ethiopia_coffee_2020


def model(dbt, session):
    dbt.config(materialized="external")

    # Declaring the sources so they appear in the documentation / lineage
    silver_trade_data = dbt.ref("silver_ethiopia_coffee_2020")
    df = gold_ethiopia_coffee_2020.get_gold_ethiopia_coffee_2020()

    final_data = session.sql(
        f"""
        WITH final_fields AS (
            SELECT
                YEAR::INT AS year,
                EXPORTER_NAME AS exporter_label,
                EXPORTER_ID AS exporter_node_id,
                EXPORTER_GROUP AS exporter_group_name,
                COUNTRY_DESTINATION AS country_of_destination,
                NET_WEIGHT/1000 AS mass_tonnes,
                FOB_VALUE_IN_USD AS fob,
                BUYER_NAME AS importer_label,
                CAST(NULL AS VARCHAR) AS port_of_export_label,
                HS_CODE AS hs6
            FROM df
        )
        SELECT * FROM final_fields
    """
    ).arrow()
    # Saving as arrow as pandas converts the port_of_export_label to int32 even with casting

    return final_data