-
Notifications
You must be signed in to change notification settings - Fork 74
Open
Labels
Description
Describe the bug
Error shown when trying to add column level databricks_tags.
dbt1060: While parsing config: Ignored unexpected key "databricks_tags". YAML path: columns[1].config.databricks_tags.
Note, view/table level databricks_tags get applied correctly.
As described on this dbt documentation page : Configuring columns
What version of dbt Fusion is this bug in? (find out by running dbt --version)
dbt-fusion 2.0.0-preview.48
Is this a discrepancy between the dbt Fusion Engine and dbt Core? Check one.
- YES
- NO
To Reproduce
version: 2
models:
- name: stg_members
description: Simulated test data for members.
config:
databricks_tags:
contains_pii: true
persist_docs:
columns: true
relation: true
meta:
source_name: stream_data
source_table: stream_members
columns:
- name: membership_number
description: The membership number
config:
meta:
dot_column_name: json_payload
dot_location: membership_number
dq:
- not_null
- not_blank
- unique
- name: email_address
description: The members email address
config:
databricks_tags:
contains_pii: true
meta:
databricks_tags:
contains_pii: true
dot_column_name: json_payload
dot_location: email_address
dq:
- not_null
- not_blank
- name: regex_match
pattern: '^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\\.[a-zA-Z]{2,}$'
- not_banned
Expected behavior
dbt-fusion not to error.
column tags to be applied to databricks column
Screenshots
Operating System and CPU Type (please complete the following information):
OS Name Microsoft Windows 10 Pro
Version 10.0.19045 Build 19045
Other OS Description Not Available
OS Manufacturer Microsoft Corporation
System Name DESKTOP-2PAM4OI
System Manufacturer Dell Inc.
System Model XPS 13 9310
System Type x64-based PC
System SKU 0991
Processor 11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz, 2995 Mhz, 4 Core(s), 8 Logical Processor(s)
BIOS Version/Date Dell Inc. 3.34.0, 08/08/2025
SMBIOS Version 3.2
Embedded Controller Version 255.255
BIOS Mode UEFI
BaseBoard Manufacturer Dell Inc.
BaseBoard Product 0DXP1F
BaseBoard Version A00
Platform Role Mobile
Secure Boot State On
PCR7 Configuration Elevation Required to View
Windows Directory C:\WINDOWS
System Directory C:\WINDOWS\system32
Boot Device \Device\HarddiskVolume1
Locale United States
Hardware Abstraction Layer Version = "10.0.19041.6456"
Time Zone GMT Standard Time
Installed Physical Memory (RAM) 16.0 GB
Total Physical Memory 15.7 GB
Available Physical Memory 2.77 GB
Total Virtual Memory 20.1 GB
Available Virtual Memory 2.73 GB
Page File Space 4.37 GB
Page File C:\pagefile.sys
Kernel DMA Protection On
Virtualization-based security Not enabled
Device Encryption Support Elevation Required to View
Hyper-V - VM Monitor Mode Extensions Yes
Hyper-V - Second Level Address Translation Extensions Yes
Hyper-V - Virtualization Enabled in Firmware Yes
Hyper-V - Data Execution Protection Yes