Skip to content

Commit b5743df

Browse files
epipavepipav
committed
feat: activityRelation buckets for subset of projects
1 parent 63c9bd8 commit b5743df

File tree

174 files changed

+2907
-536
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

174 files changed

+2907
-536
lines changed

‎services/libs/tinybird/datasources/activities_backup_consistency_audit.datasource‎

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
DESCRIPTION >
2+
Stores periodic consistency metrics between `activities` and `activities_backup`.
3+
4+
SCHEMA >
5+
`computedAt` DateTime,
6+
`uniq_ids_src` UInt64,
7+
`uniq_ids_bkp` UInt64,
8+
`count_final_src` UInt64,
9+
`count_final_bkp` UInt64,
10+
`diff_uniq` Int64,
11+
`diff_final` Int64,
12+
`pct_diff_uniq` Float64,
13+
`pct_diff_final` Float64
14+
15+
ENGINE MergeTree
16+
ENGINE_PARTITION_KEY toYear(computedAt)
17+
ENGINE_SORTING_KEY computedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_0_ds.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE MergeTree
27+
ENGINE_PARTITION_KEY toYYYYMM(`createdAt`)
28+
ENGINE_SORTING_KEY createdAt, gitDeletions, score, isContribution
29+
ENGINE_TTL ""

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_0.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_1.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_2.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_3.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_4.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_5.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_6.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

‎services/libs/tinybird/datasources/activityRelations_bucket_MV_ds_7.datasource‎

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
SCHEMA >
2+
`activityId` String,
3+
`conversationId` String,
4+
`createdAt` DateTime64(3),
5+
`updatedAt` DateTime64(3),
6+
`memberId` String,
7+
`objectMemberId` String,
8+
`objectMemberUsername` String,
9+
`organizationId` String,
10+
`parentId` String,
11+
`platform` LowCardinality(String),
12+
`segmentId` String,
13+
`username` String,
14+
`sourceId` String,
15+
`type` LowCardinality(String),
16+
`timestamp` DateTime64(3),
17+
`sourceParentId` String,
18+
`channel` String,
19+
`sentimentScore` Int8,
20+
`gitInsertions` UInt32,
21+
`gitDeletions` UInt32,
22+
`score` Int8,
23+
`isContribution` UInt8,
24+
`pullRequestReviewState` LowCardinality(String)
25+
26+
ENGINE ReplacingMergeTree
27+
ENGINE_PARTITION_KEY toYear(createdAt)
28+
ENGINE_SORTING_KEY segmentId, timestamp, type, platform, channel, sourceId
29+
ENGINE_VER updatedAt

0 commit comments

Comments
 (0)