Skip to content

[BUG] Column Level databricks_tags erroring out #957

@davidbeaty-a8

Description

@davidbeaty-a8

Describe the bug
Error shown when trying to add column level databricks_tags.

dbt1060: While parsing config: Ignored unexpected key "databricks_tags". YAML path: columns[1].config.databricks_tags.

Note, view/table level databricks_tags get applied correctly.

As described on this dbt documentation page : Configuring columns

What version of dbt Fusion is this bug in? (find out by running dbt --version)
dbt-fusion 2.0.0-preview.48

Is this a discrepancy between the dbt Fusion Engine and dbt Core? Check one.

  • YES
  • NO

To Reproduce

version: 2
models:
  - name: stg_members
    description: Simulated test data for members.
    config:
      databricks_tags:
        contains_pii: true
      persist_docs:
        columns: true
        relation: true
      meta:
        source_name: stream_data
        source_table: stream_members
    columns:
      - name: membership_number
        description: The membership number
        config:
          meta:
            dot_column_name: json_payload
            dot_location: membership_number
            dq:
              - not_null
              - not_blank
              - unique
      - name: email_address
        description: The members email address
        config:
          databricks_tags:
            contains_pii: true
          meta:
            databricks_tags:
              contains_pii: true
            dot_column_name: json_payload
            dot_location: email_address
            dq:
              - not_null
              - not_blank
              - name: regex_match
                pattern: '^[a-zA-Z0-9._%+-]+@[a-zA-Z0-9.-]+\\.[a-zA-Z]{2,}$'
              - not_banned

Expected behavior
dbt-fusion not to error.
column tags to be applied to databricks column

Screenshots

Image

Operating System and CPU Type (please complete the following information):

OS Name	Microsoft Windows 10 Pro
Version	10.0.19045 Build 19045
Other OS Description 	Not Available
OS Manufacturer	Microsoft Corporation
System Name	DESKTOP-2PAM4OI
System Manufacturer	Dell Inc.
System Model	XPS 13 9310
System Type	x64-based PC
System SKU	0991
Processor	11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz, 2995 Mhz, 4 Core(s), 8 Logical Processor(s)
BIOS Version/Date	Dell Inc. 3.34.0, 08/08/2025
SMBIOS Version	3.2
Embedded Controller Version	255.255
BIOS Mode	UEFI
BaseBoard Manufacturer	Dell Inc.
BaseBoard Product	0DXP1F
BaseBoard Version	A00
Platform Role	Mobile
Secure Boot State	On
PCR7 Configuration	Elevation Required to View
Windows Directory	C:\WINDOWS
System Directory	C:\WINDOWS\system32
Boot Device	\Device\HarddiskVolume1
Locale	United States
Hardware Abstraction Layer	Version = "10.0.19041.6456"
Time Zone	GMT Standard Time
Installed Physical Memory (RAM)	16.0 GB
Total Physical Memory	15.7 GB
Available Physical Memory	2.77 GB
Total Virtual Memory	20.1 GB
Available Virtual Memory	2.73 GB
Page File Space	4.37 GB
Page File	C:\pagefile.sys
Kernel DMA Protection	On
Virtualization-based security	Not enabled
Device Encryption Support	Elevation Required to View
Hyper-V - VM Monitor Mode Extensions	Yes
Hyper-V - Second Level Address Translation Extensions	Yes
Hyper-V - Virtualization Enabled in Firmware	Yes
Hyper-V - Data Execution Protection	Yes

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions