Skip to content

Commit 4c59bcf

Browse files
tarakaswathi-datazipImDoubD-datazipdeepanshupal09-datazip
authored
test: ✅ base setup for automation testing using play… (#203)
* test: ✅ base setup for automation testing using playwright , add test cases fro major flows * fix: integration workflow changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * fix: ci changes * test: add postgres flow * fix: lint changes * test: add iceberg specific test * fix: tests * fix: stream name * fix: test fix * fix: test fix * fix: test fix * fix: test fix * fix: changes * fix: ci changes * fix: ci changes * fix: ci changes * test: fail test on test connection failure * fix: ci changes * fix: changes * fix: changes * fix: changes * fix: changes * fix: changes * fix: changes * fix: test fix * fix: changes * fix: changes * fix: test-data fix * fix: test-data fix * fix: changes * fix: changes * fix: changes * fix: host and port changes * fix: changes * fix: change * test: login test updated * test: refactor create source and destination page * test: refactor tests * fix: test fix * fix: changes * fix: fix changes * fix: changes * fix: changes * fix: review changes * refactor: refactor tests to use authenticated state of playwright * fix: changes * docs: update tests readme * test: intercept and log destination spec response * docs: update readme * fix: update timeouts for playwright tests * test: update readme * fix: add retries in playwright config * test: fix timeout duration * fix: update readme * test: add connector data test-id * fix: resolve comments * refactor(test): make and use enums instead of strings * fix: fix test data builder * fix: test data job name * fix: add todo --------- Co-authored-by: Duke Dhal <[email protected]> Co-authored-by: deepanshupal09-datazip <[email protected]>
1 parent 526d35b commit 4c59bcf

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

53 files changed

+4997
-60
lines changed

‎.github/workflows/integration-test.yml‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
name: Integration Tests
2+
on:
3+
push:
4+
branches:
5+
- master
6+
pull_request:
7+
branches:
8+
- "*"
9+
10+
jobs:
11+
integration-tests:
12+
runs-on: 32gb-runner
13+
timeout-minutes: 30
14+
steps:
15+
- name: Checkout code
16+
uses: actions/checkout@v3
17+
18+
- name: Set up Go
19+
uses: actions/setup-go@v4
20+
with:
21+
go-version: '1.23.2'
22+
23+
- name: Download Go dependencies
24+
working-directory: ./server
25+
run: go mod download
26+
27+
- name: Run Docker In Docker Container Tests
28+
working-directory: ./server
29+
run: go test -v ./tests -timeout 0 -run 'TestDinDIntegration'

‎.gitignore‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,3 +45,11 @@ npm-debug*
4545
# ----------------------------
4646
*.env
4747
*.env.*
48+
49+
# ----------------------------
50+
# Test Files
51+
# ----------------------------
52+
ui/test-results/
53+
ui/playwright-report/
54+
ui/blob-report/
55+
ui/tests/.auth/

‎server/go.mod‎

Lines changed: 80 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -5,17 +5,80 @@ go 1.24.2
55
require github.com/beego/beego/v2 v2.3.8
66

77
require (
8+
github.com/apache/spark-connect-go/v35 v35.0.0-20250317154112-ffd832059443
89
github.com/aws/aws-sdk-go-v2/config v1.31.0
910
github.com/aws/aws-sdk-go-v2/service/ecr v1.49.0
1011
github.com/aws/aws-sdk-go-v2/service/kms v1.41.1
12+
github.com/docker/docker v28.3.3+incompatible
1113
github.com/lib/pq v1.10.9
1214
github.com/oklog/ulid v1.3.1
1315
github.com/spf13/viper v1.20.1
16+
github.com/testcontainers/testcontainers-go v0.39.0
1417
go.temporal.io/sdk v1.34.0
15-
golang.org/x/crypto v0.35.0
18+
golang.org/x/crypto v0.41.0
1619
golang.org/x/mod v0.27.0
1720
)
1821

22+
require (
23+
cloud.google.com/go/compute/metadata v0.7.0 // indirect
24+
dario.cat/mergo v1.0.2 // indirect
25+
github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 // indirect
26+
github.com/Microsoft/go-winio v0.6.2 // indirect
27+
github.com/apache/arrow-go/v18 v18.2.0 // indirect
28+
github.com/cenkalti/backoff/v4 v4.2.1 // indirect
29+
github.com/containerd/errdefs v1.0.0 // indirect
30+
github.com/containerd/errdefs/pkg v0.3.0 // indirect
31+
github.com/containerd/log v0.1.0 // indirect
32+
github.com/containerd/platforms v0.2.1 // indirect
33+
github.com/cpuguy83/dockercfg v0.3.2 // indirect
34+
github.com/distribution/reference v0.6.0 // indirect
35+
github.com/docker/go-connections v0.6.0 // indirect
36+
github.com/docker/go-units v0.5.0 // indirect
37+
github.com/ebitengine/purego v0.8.4 // indirect
38+
github.com/felixge/httpsnoop v1.0.4 // indirect
39+
github.com/go-errors/errors v1.5.1 // indirect
40+
github.com/go-logr/logr v1.4.3 // indirect
41+
github.com/go-logr/stdr v1.2.2 // indirect
42+
github.com/go-ole/go-ole v1.2.6 // indirect
43+
github.com/goccy/go-json v0.10.5 // indirect
44+
github.com/google/flatbuffers v25.2.10+incompatible // indirect
45+
github.com/klauspost/compress v1.18.0 // indirect
46+
github.com/klauspost/cpuid/v2 v2.2.10 // indirect
47+
github.com/lufia/plan9stats v0.0.0-20211012122336-39d0f177ccd0 // indirect
48+
github.com/magiconair/properties v1.8.10 // indirect
49+
github.com/moby/docker-image-spec v1.3.1 // indirect
50+
github.com/moby/go-archive v0.1.0 // indirect
51+
github.com/moby/patternmatcher v0.6.0 // indirect
52+
github.com/moby/sys/sequential v0.6.0 // indirect
53+
github.com/moby/sys/user v0.4.0 // indirect
54+
github.com/moby/sys/userns v0.1.0 // indirect
55+
github.com/moby/term v0.5.0 // indirect
56+
github.com/morikuni/aec v1.0.0 // indirect
57+
github.com/opencontainers/go-digest v1.0.0 // indirect
58+
github.com/opencontainers/image-spec v1.1.1 // indirect
59+
github.com/pierrec/lz4/v4 v4.1.22 // indirect
60+
github.com/pkg/errors v0.9.1 // indirect
61+
github.com/power-devops/perfstat v0.0.0-20210106213030-5aafc221ea8c // indirect
62+
github.com/shirou/gopsutil/v4 v4.25.6 // indirect
63+
github.com/sirupsen/logrus v1.9.3 // indirect
64+
github.com/tklauser/go-sysconf v0.3.12 // indirect
65+
github.com/tklauser/numcpus v0.6.1 // indirect
66+
github.com/yusufpapurcu/wmi v1.2.4 // indirect
67+
github.com/zeebo/xxh3 v1.0.2 // indirect
68+
go.opentelemetry.io/auto/sdk v1.1.0 // indirect
69+
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.54.0 // indirect
70+
go.opentelemetry.io/otel v1.38.0 // indirect
71+
go.opentelemetry.io/otel/exporters/otlp/otlptrace v1.38.0 // indirect
72+
go.opentelemetry.io/otel/metric v1.38.0 // indirect
73+
go.opentelemetry.io/otel/sdk/metric v1.38.0 // indirect
74+
go.opentelemetry.io/otel/trace v1.38.0 // indirect
75+
go.opentelemetry.io/proto/otlp v1.8.0 // indirect
76+
golang.org/x/exp v0.0.0-20240909161429-701f63a606c0 // indirect
77+
golang.org/x/oauth2 v0.30.0 // indirect
78+
golang.org/x/tools v0.35.0 // indirect
79+
golang.org/x/xerrors v0.0.0-20240903120638-7835f813f4da // indirect
80+
)
81+
1982
require (
2083
github.com/aws/aws-sdk-go-v2 v1.38.0
2184
github.com/aws/aws-sdk-go-v2/credentials v1.18.4 // indirect
@@ -34,46 +97,46 @@ require (
3497
require (
3598
github.com/beorn7/perks v1.0.1 // indirect
3699
github.com/cespare/xxhash/v2 v2.3.0 // indirect
37-
github.com/davecgh/go-spew v1.1.1 // indirect
100+
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
38101
github.com/facebookgo/clock v0.0.0-20150410010913-600d898af40a // indirect
39102
github.com/fsnotify/fsnotify v1.8.0 // indirect
40103
github.com/go-viper/mapstructure/v2 v2.3.0 // indirect
41104
github.com/gogo/protobuf v1.3.2 // indirect
42105
github.com/golang/mock v1.6.0 // indirect
43106
github.com/google/uuid v1.6.0 // indirect
44107
github.com/grpc-ecosystem/go-grpc-middleware v1.4.0 // indirect
45-
github.com/grpc-ecosystem/grpc-gateway/v2 v2.22.0 // indirect
108+
github.com/grpc-ecosystem/grpc-gateway/v2 v2.27.2 // indirect
46109
github.com/hashicorp/golang-lru v0.5.4 // indirect
110+
github.com/jmoiron/sqlx v1.4.0
47111
github.com/mitchellh/mapstructure v1.5.0 // indirect
48112
github.com/nexus-rpc/sdk-go v0.3.0 // indirect
49113
github.com/pelletier/go-toml/v2 v2.2.3 // indirect
50-
github.com/pmezard/go-difflib v1.0.0 // indirect
114+
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
51115
github.com/prometheus/client_golang v1.19.0 // indirect
52116
github.com/prometheus/client_model v0.5.0 // indirect
53117
github.com/prometheus/common v0.48.0 // indirect
54118
github.com/prometheus/procfs v0.12.0 // indirect
55119
github.com/robfig/cron v1.2.0
56-
github.com/sagikazarmark/locafero v0.7.0 // indirect
120+
github.com/sagikazarmark/locafero v0.8.0 // indirect
57121
github.com/shiena/ansicolor v0.0.0-20200904210342-c7312218db18 // indirect
58122
github.com/sourcegraph/conc v0.3.0 // indirect
59-
github.com/spf13/afero v1.12.0 // indirect
123+
github.com/spf13/afero v1.14.0 // indirect
60124
github.com/spf13/cast v1.7.1 // indirect
61125
github.com/spf13/pflag v1.0.6 // indirect
62126
github.com/stretchr/objx v0.5.2 // indirect
63-
github.com/stretchr/testify v1.10.0 // indirect
127+
github.com/stretchr/testify v1.11.1
64128
github.com/subosito/gotenv v1.6.0 // indirect
65129
github.com/valyala/bytebufferpool v1.0.0 // indirect
66130
go.temporal.io/api v1.46.0
67-
go.uber.org/atomic v1.9.0 // indirect
68-
go.uber.org/multierr v1.9.0 // indirect
69-
golang.org/x/net v0.36.0 // indirect
70-
golang.org/x/sync v0.11.0 // indirect
71-
golang.org/x/sys v0.30.0 // indirect
72-
golang.org/x/text v0.22.0 // indirect
131+
go.uber.org/multierr v1.11.0 // indirect
132+
golang.org/x/net v0.43.0 // indirect
133+
golang.org/x/sync v0.16.0 // indirect
134+
golang.org/x/sys v0.36.0 // indirect
135+
golang.org/x/text v0.28.0 // indirect
73136
golang.org/x/time v0.8.0 // indirect
74-
google.golang.org/genproto/googleapis/api v0.0.0-20241209162323-e6fa225c2576 // indirect
75-
google.golang.org/genproto/googleapis/rpc v0.0.0-20241223144023-3abc09e42ca8 // indirect
76-
google.golang.org/grpc v1.67.3 // indirect
77-
google.golang.org/protobuf v1.36.5 // indirect
137+
google.golang.org/genproto/googleapis/api v0.0.0-20250825161204-c5933d9347a5 // indirect
138+
google.golang.org/genproto/googleapis/rpc v0.0.0-20250825161204-c5933d9347a5 // indirect
139+
google.golang.org/grpc v1.75.0 // indirect
140+
google.golang.org/protobuf v1.36.8 // indirect
78141
gopkg.in/yaml.v3 v3.0.1 // indirect
79142
)

0 commit comments

Comments
 (0)