DBT Exposure: Brazil logistics silo map v2: PII analysis
DBT exposure name: brazil_logistics_silo_map_v2_pii_analysis
Type: notebook
Owner: harry
Description
Quantifies how much individual-level PII (personal names, CPF tax IDs) sits in the
pre-publication silo map file, broken down by source system (SICARM, CNPJ/Receita
Federal, Google Maps). Classifies tax IDs as CPF vs CNPJ, applies a fuzzy name-matching
heuristic to flag rows that identify a specific individual, and checks what
distinguishing/re-identifying columns (e.g. lat/lng, SICARM CDA code) remain once
name and cnpj are removed.
Details
-
Dbt path:
trase_duckdb.brazil_logistics_silo_map_v2_pii_analysis -
Exposure yml: trase/data_pipeline/models/brazil/logistics/silos/silo_map_v2/_exposures.yml
-
Tags:
brazil,logistics,pii,qa,silos,soy