[BUG]: Invalid Module Imports

[jblacker]

Tracer Version(s)

2.3.1

Go Version(s)

go1.25.3 darwin arm64

Bug Report

ddtrace is depending on datadog-agent, which depends on the go.opentelemetry.io/collector/pdata/internal/data module, but this module was removed from the OTEL project. This leads to a ton of errors when running go mod tidy and causes builds to fail. I found that unless I downgrade to v 1.74.6 this tends to happen for most projects.

go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/profiles/v1development
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/profiles/v1development
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1
go: github.com/justworkshr/communications/cmd imports
	github.com/DataDog/dd-trace-go/v2/ddtrace/tracer imports
	github.com/DataDog/datadog-agent/pkg/trace/stats imports
	github.com/DataDog/datadog-agent/pkg/trace/transform imports
	github.com/DataDog/datadog-agent/pkg/trace/sampler tested by
	github.com/DataDog/datadog-agent/pkg/trace/sampler.test imports
	go.opentelemetry.io/collector/processor/processortest imports
	go.opentelemetry.io/collector/consumer/consumertest imports
	go.opentelemetry.io/collector/pdata/pprofile imports
	go.opentelemetry.io/collector/pdata/internal/data: module go.opentelemetry.io/collector/pdata@latest found (v1.46.0), but does not contain package go.opentelemetry.io/collector/pdata/internal/data
go: github.com/justworkshr/communications/cmd imports
	github.com/DataDog/dd-trace-go/v2/ddtrace/tracer imports
	github.com/DataDog/datadog-agent/pkg/trace/stats imports
	github.com/DataDog/datadog-agent/pkg/trace/transform imports
	github.com/DataDog/datadog-agent/pkg/trace/sampler tested by
	github.com/DataDog/datadog-agent/pkg/trace/sampler.test imports
	go.opentelemetry.io/collector/processor/processortest imports
	go.opentelemetry.io/collector/consumer/consumertest imports
	go.opentelemetry.io/collector/pdata/pprofile imports
	go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/profiles/v1development: module go.opentelemetry.io/collector/pdata@latest found (v1.46.0), but does not contain package go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/profiles/v1development
go: github.com/justworkshr/communications/cmd imports
	github.com/DataDog/dd-trace-go/v2/ddtrace/tracer imports
	github.com/DataDog/datadog-agent/pkg/trace/stats imports
	github.com/DataDog/datadog-agent/pkg/trace/transform imports
	github.com/DataDog/datadog-agent/pkg/trace/sampler tested by
	github.com/DataDog/datadog-agent/pkg/trace/sampler.test imports
	go.opentelemetry.io/collector/processor/processortest imports
	go.opentelemetry.io/collector/consumer/consumertest imports
	go.opentelemetry.io/collector/pdata/pprofile imports
	go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1: module go.opentelemetry.io/collector/pdata@latest found (v1.46.0), but does not contain package go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1
go: github.com/justworkshr/communications/cmd imports
	github.com/DataDog/dd-trace-go/v2/ddtrace/tracer imports
	github.com/DataDog/datadog-agent/pkg/trace/stats imports
	github.com/DataDog/datadog-agent/pkg/trace/transform imports
	github.com/DataDog/datadog-agent/pkg/trace/sampler tested by
	github.com/DataDog/datadog-agent/pkg/trace/sampler.test imports
	go.opentelemetry.io/collector/processor/processortest imports
	go.opentelemetry.io/collector/consumer/consumertest imports
	go.opentelemetry.io/collector/pdata/pprofile imports
	go.opentelemetry.io/collector/pdata/internal/data/protogen/profiles/v1development: module go.opentelemetry.io/collector/pdata@latest found (v1.46.0), but does not contain package go.opentelemetry.io/collector/pdata/internal/data/protogen/profiles/v1development

Reproduction Code

No response

Error Logs

No response

Go Env Output

AR='ar'
CC='clang'
CGO_CFLAGS='-O2 -g'
CGO_CPPFLAGS=''
CGO_CXXFLAGS='-O2 -g'
CGO_ENABLED='1'
CGO_FFLAGS='-O2 -g'
CGO_LDFLAGS='-O2 -g'
CXX='clang++'
GCCGO='gccgo'
GO111MODULE=''
GOARCH='arm64'
GOARM64='v8.0'
GOAUTH='netrc'
GOBIN=''
GOCACHE='/Users/jordanblacker/Library/Caches/go-build'
GOCACHEPROG=''
GODEBUG=''
GOENV='/Users/jordanblacker/Library/Application Support/go/env'
GOEXE=''
GOEXPERIMENT=''
GOFIPS140='off'
GOFLAGS=''
GOGCCFLAGS='-fPIC -arch arm64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -ffile-prefix-map=/var/folders/2t/mgrzy4694ssb_27bpm3wjmhw0000gp/T/go-build4200598242=/tmp/go-build -gno-record-gcc-switches -fno-common'
GOHOSTARCH='arm64'
GOHOSTOS='darwin'
GOINSECURE=''
GOMOD='/Users/jordanblacker/justworks/communications/go.mod'
GOMODCACHE='/Users/jordanblacker/go/pkg/mod'
GONOPROXY='github.com/justworkshr/*'
GONOSUMDB='github.com/justworkshr/*'
GOOS='darwin'
GOPATH='/Users/jordanblacker/go'
GOPRIVATE='github.com/justworkshr/*'
GOPROXY='https://proxy.golang.org,direct'
GOROOT='/Users/jordanblacker/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.3.darwin-arm64'
GOSUMDB='sum.golang.org'
GOTELEMETRY='local'
GOTELEMETRYDIR='/Users/jordanblacker/Library/Application Support/go/telemetry'
GOTMPDIR=''
GOTOOLCHAIN='auto'
GOTOOLDIR='/Users/jordanblacker/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.3.darwin-arm64/pkg/tool/darwin_arm64'
GOVCS=''
GOVERSION='go1.25.3'
GOWORK=''
PKG_CONFIG='pkg-config'

[darccio]

Hi @jblacker, we'll take a look between today and tomorrow. Are you instrumenting with dd-trace-go API or using our OTel trace provider? Just to make sure our repro code is the most accurate possible.

[zekth]

We're having the same issue. using gopkg.in/DataDog/dd-trace-go.v1 v1.74.7 without otel

[darccio]

@zekth @jblacker We tried to reproduce it but it works for us right now. We created a simple server:

package main

import (
	"net/http"

	"gopkg.in/DataDog/dd-trace-go.v1/ddtrace/tracer"
	httptrace "gopkg.in/DataDog/dd-trace-go.v1/contrib/net/http"
)

func main() {
	tracer.Start()
	defer tracer.Stop()

	mux := httptrace.NewServeMux()
	mux.HandleFunc("/", func(w http.ResponseWriter, r *http.Request) {
		w.Write([]byte("Hello World!\n"))
	})
	http.ListenAndServe(":8080", mux)
}

And we ensured our Go toolchain pulled the exact version:

export GOPROXY=proxy.golang.org,direct
go clean -modcache
go get gopkg.in/DataDog/dd-trace-go.v1@v1.74.7
go mod tidy
go build

Edit: updated example to explicitly import the tracer.

[zekth]

@darccio seems like your example is not importing the tracer
see the example provided:

go: github.com/justworkshr/communications/cmd imports
	github.com/DataDog/dd-trace-go/v2/ddtrace/tracer imports
	github.com/DataDog/datadog-agent/pkg/trace/stats imports
	github.com/DataDog/datadog-agent/pkg/trace/transform imports
	github.com/DataDog/datadog-agent/pkg/trace/sampler tested by
	github.com/DataDog/datadog-agent/pkg/trace/sampler.test imports
	go.opentelemetry.io/collector/processor/processortest imports
	go.opentelemetry.io/collector/consumer/consumertest imports
	go.opentelemetry.io/collector/pdata/pprofile imports
	go.opentelemetry.io/collector/pdata/internal/data: module go.opentelemetry.io/collector/pdata@latest

I have the same issue with the tracer import

[darccio]

@zekth It shouldn't matter for the module resolution. I updated the example and tried. Same non-reproducible result.

This is my go env output:

AR='ar'
CC='cc'
CGO_CFLAGS='-O2 -g'
CGO_CPPFLAGS=''
CGO_CXXFLAGS='-O2 -g'
CGO_ENABLED='1'
CGO_FFLAGS='-O2 -g'
CGO_LDFLAGS='-O2 -g'
CXX='c++'
GCCGO='gccgo'
GO111MODULE='auto'
GOARCH='arm64'
GOARM64='v8.0'
GOAUTH='netrc'
GOBIN=''
GOCACHE='/Users/dario.castane/Library/Caches/go-build'
GOCACHEPROG=''
GODEBUG=''
GOENV='/Users/dario.castane/Library/Application Support/go/env'
GOEXE=''
GOEXPERIMENT=''
GOFIPS140='off'
GOFLAGS=''
GOGCCFLAGS='-fPIC -arch arm64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -ffile-prefix-map=/var/folders/jz/200n23xd7fd94f51mt3787qm0000gn/T/go-build3692135858=/tmp/go-build -gno-record-gcc-switches -fno-common'
GOHOSTARCH='arm64'
GOHOSTOS='darwin'
GOINSECURE=''
GOMOD='/Users/dario.castane/Code/puppies/go-gopkgin/go.mod'
GOMODCACHE='/Users/dario.castane/go/pkg/mod'
GONOPROXY='github.com/DataDog,github.com/darccio/knobs'
GONOSUMDB='github.com/DataDog,go.ddbuild.io'
GOOS='darwin'
GOPATH='/Users/dario.castane/go'
GOPRIVATE='github.com/DataDog,github.com/darccio/knobs'
GOPROXY='proxy.golang.org,direct'
GOROOT='/opt/homebrew/Cellar/go/1.25.4/libexec'
GOSUMDB='sum.golang.org'
GOTELEMETRY='on'
GOTELEMETRYDIR='/Users/dario.castane/Library/Application Support/go/telemetry'
GOTMPDIR=''
GOTOOLCHAIN='auto'
GOTOOLDIR='/opt/homebrew/Cellar/go/1.25.4/libexec/pkg/tool/darwin_arm64'
GOVCS=''
GOVERSION='go1.25.4'
GOWORK=''
PKG_CONFIG='pkg-config'

[darccio]

This looks like a repetition of #3059. Probably the workaround should be bumping the right package to the right version.

[zekth]

interestingly the example you shared works on my machine but a project using it doesn't.

go env

AR='ar'
CC='clang'
CGO_CFLAGS='-O2 -g'
CGO_CPPFLAGS=''
CGO_CXXFLAGS='-O2 -g'
CGO_ENABLED='1'
CGO_FFLAGS='-O2 -g'
CGO_LDFLAGS='-O2 -g'
CXX='clang++'
GCCGO='gccgo'
GO111MODULE=''
GOARCH='arm64'
GOARM64='v8.0'
GOAUTH='netrc'
GOBIN=''
GOCACHE='/Users/xxx/Library/Caches/go-build'
GOCACHEPROG=''
GODEBUG=''
GOENV='/Users/xxx/Library/Application Support/go/env'
GOEXE=''
GOEXPERIMENT=''
GOFIPS140='off'
GOFLAGS=''
GOGCCFLAGS='-fPIC -arch arm64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -ffile-prefix-map=/var/folders/c5/v5pjf9md619csnt4hvzyj9jm0000gn/T/go-build942000903=/tmp/go-build -gno-record-gcc-switches -fno-common'
GOHOSTARCH='arm64'
GOHOSTOS='darwin'
GOINSECURE=''
GOMOD='/Users/xxx/kong/xxx/go.mod'
GOMODCACHE='/Users/xxx/go/pkg/mod'
GONOPROXY='github.com'
GONOSUMDB='github.com'
GOOS='darwin'
GOPATH='/Users/xxx/go'
GOPRIVATE='github.com'
GOPROXY='proxy.golang.org,direct'
GOROOT='/Users/xxxx/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.darwin-arm64'
GOSUMDB='sum.golang.org'
GOTELEMETRY='local'
GOTELEMETRYDIR='/Users/xxx/Library/Application Support/go/telemetry'
GOTMPDIR=''
GOTOOLCHAIN='auto'
GOTOOLDIR='/Users/xxx/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.25.0.darwin-arm64/pkg/tool/darwin_arm64'
GOVCS=''
GOVERSION='go1.25.0'
GOWORK=''
PKG_CONFIG='pkg-config'

[darccio]

@zekth What packages are you importing in the project?

[zekth]

gopkg.in/DataDog/dd-trace-go.v1 v1.74.8

[zekth]

~/kong/xxx feat/redisfx !2 ❯ go mod tidy                                                                                                                                  19:21:38
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/common/v1
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/collector/profiles/v1development
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data/protogen/profiles/v1development
go: finding module for package go.opentelemetry.io/collector/pdata/internal/data
go: github.com/kong-konnect/xxx/internal/xxx/xxx imports
        gopkg.in/DataDog/dd-trace-go.v1/ddtrace/tracer tested by
        gopkg.in/DataDog/dd-trace-go.v1/ddtrace/tracer.test imports
        gopkg.in/DataDog/dd-trace-go.v1/internal imports
        go.opentelemetry.io/collector/pdata/pprofile imports
        go.opentelemetry.io/collector/pdata/internal/data: module go.opentelemetry.io/collector/pdata@latest found (v1.46.0), but does not contain package go.opentelemetry.io/collector/pdata/internal/data

[darccio]

@zekth I meant the imports used in your code. Specific contribs, additional products, etc.