Skip to content

Move files from cloudberry-devops-release to main repo #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
leborchuk wants to merge 26 commits into
base: main
Choose a base branch
from
Open

Move files from cloudberry-devops-release to main repo #2

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
29d2a2a
feat: use ColumnEncoding_Kind_DIRECT_DELTA as default in offset strea…
gongxun0928 Sep 3, 2025
be6717c
PAX: Support LZ4 compression for table columns (#1344)
gfphoenix78 Sep 4, 2025
19720e8
Fix compilation with --disable-orca
yjhjstz Sep 2, 2025
4a2dd03
Fix: if tableam implement relation_acquire_sample_rows, then just use it
lss602726449 Aug 27, 2025
b8a78af
Fix: quick exit in dumptuples if query execution is finished
HuSen8891 Aug 29, 2025
5142c0e
Fix names of pg_stat_all_tables|indexes
huansong Mar 20, 2023
86306e0
Add gp_stat_progress_%_summary system views
l-wang Apr 27, 2023
2b1c9c3
Add gp summary system views
AJR-VMware Apr 7, 2023
05869c8
Fix: Adapt system view after cherry-pick
lss602726449 Sep 3, 2025
194d897
Enhancement: use `-e` in getversion to check Git repo
smartyhero Aug 18, 2025
25d6490
gpMgmt: skip downloading existing Python dependency tarballs
yjhjstz Aug 26, 2025
54fc80f
Fix writable CTE on replicated tables EXCEPT partition tables.
avamingli Aug 6, 2025
1d010b4
Revert "Fix double free issue in alterResgroupCallback during io_limi…
zhangyue-hashdata Aug 29, 2025
e5c8ebb
let resource group io limit testing can be reproduced (#16107)
RMTT Aug 1, 2023
8369cf6
Improve io_limit behaviors (#16351)
RMTT Sep 7, 2023
0735df4
Fix resource group io limit flaky case (#16386)
RMTT Sep 7, 2023
6080221
Io limit improve error log (#16394)
RMTT Sep 12, 2023
92bee97
io limit: fix double free (#16459)
RMTT Sep 20, 2023
723ee28
Add one more hierarchy for resgroup cgroup root (#16732)
RMTT Dec 5, 2023
c4e0a80
delete cgroup leaf dir only when use group-v2 (#16830)
RMTT Dec 12, 2023
36b6ddd
Add guc: gp_resource_group_cgroup_parent (#16738)
RMTT Dec 19, 2023
996d0e4
Fix no response when alter io_limit of resource group to '-1' (#17095)
RMTT Feb 27, 2024
caeee21
Fix gpcheckresgroupv2impl to use dynamic cgroup parent from GUC param…
zhangyue-hashdata Aug 31, 2025
52d87cd
feat: support runtime filter push down to Table AM
gongxun0928 Aug 21, 2025
ff2e9bc
This is the initial commit for moving cloudberry-devops-release to ma…
Aug 27, 2025
753e4ee
Reorganize files in main repo and add licence info to all files
Aug 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
62 changes: 13 additions & 49 deletions .github/workflows/build-cloudberry.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -441,24 +441,6 @@ jobs:
fetch-depth: 1
submodules: true

- name: Checkout CI Build/Test Scripts
if: needs.check-skip.outputs.should_skip != 'true'
uses: actions/checkout@v4
with:
repository: apache/cloudberry-devops-release
ref: main
path: cloudberry-devops-release
fetch-depth: 1

- name: Move cloudberry-devops-release directory
if: needs.check-skip.outputs.should_skip != 'true'
run: |
set -eo pipefail
if ! mv "${GITHUB_WORKSPACE}"/cloudberry-devops-release "${GITHUB_WORKSPACE}"/..; then
echo "::error::Container initialization failed"
exit 1
fi

- name: Cloudberry Environment Initialization
if: needs.check-skip.outputs.should_skip != 'true'
env:
Expand Down Expand Up @@ -510,8 +492,8 @@ jobs:
SRC_DIR: ${{ github.workspace }}
run: |
set -eo pipefail
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/configure-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ENABLE_DEBUG=${{ env.ENABLE_DEBUG }} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/configure-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/configure-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ENABLE_DEBUG=${{ env.ENABLE_DEBUG }} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/configure-cloudberry.sh"; then
echo "::error::Configure script failed"
exit 1
fi
Expand All @@ -523,8 +505,8 @@ jobs:
run: |
set -eo pipefail

chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/build-cloudberry.sh"; then
echo "::error::Build script failed"
exit 1
fi
Expand Down Expand Up @@ -606,7 +588,7 @@ jobs:
# Create RPM
echo "Creating RPM package..."
rpmdev-setuptree
ln -s "${SRC_DIR}"/../cloudberry-devops-release/packaging/rpm/el/SPECS/apache-cloudberry-db-incubating.spec "${HOME}"/rpmbuild/SPECS/apache-cloudberry-db-incubating.spec
ln -s "${SRC_DIR}"/devops/build/packaging/rpm/apache-cloudberry-db-incubating.spec "${HOME}"/rpmbuild/SPECS/apache-cloudberry-db-incubating.spec
cp "${SRC_DIR}"/LICENSE /usr/local/cloudberry-db

DEBUG_RPMBUILD_OPT=""
Expand All @@ -616,7 +598,7 @@ jobs:
DEBUG_IDENTIFIER=".debug"
fi

"${SRC_DIR}"/../cloudberry-devops-release/scripts/build-rpm.sh --version "${CBDB_VERSION}" --release "${BUILD_NUMBER}" "${DEBUG_RPMBUILD_OPT}"
"${SRC_DIR}"/devops/build/packaging/rpm/build-rpm.sh --version "${CBDB_VERSION}" --release "${BUILD_NUMBER}" "${DEBUG_RPMBUILD_OPT}"

# Get OS version and move RPM
os_version=$(grep -oP '(?<=^VERSION_ID=")[0-9]' /etc/os-release)
Expand Down Expand Up @@ -653,8 +635,8 @@ jobs:
SRC_DIR: ${{ github.workspace }}
run: |
set -eo pipefail
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/unittest-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/unittest-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/unittest-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/unittest-cloudberry.sh"; then
echo "::error::Unittest script failed"
exit 1
fi
Expand Down Expand Up @@ -904,24 +886,6 @@ jobs:
run: |
echo "Timestamp from output: ${{ needs.build.outputs.build_timestamp }}"

- name: Checkout CI Build/Test Scripts
if: needs.check-skip.outputs.should_skip != 'true'
uses: actions/checkout@v4
with:
repository: apache/cloudberry-devops-release
ref: main
path: cloudberry-devops-release
fetch-depth: 1

- name: Move cloudberry-devops-release directory
if: needs.check-skip.outputs.should_skip != 'true'
run: |
set -eo pipefail
if ! mv "${GITHUB_WORKSPACE}"/cloudberry-devops-release "${GITHUB_WORKSPACE}"/..; then
echo "::error::Container initialization failed"
exit 1
fi

- name: Cloudberry Environment Initialization
env:
LOGS_DIR: build-logs
Expand Down Expand Up @@ -1267,8 +1231,8 @@ jobs:
set -eo pipefail

{
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && NUM_PRIMARY_MIRROR_PAIRS='${{ matrix.num_primary_mirror_pairs }}' SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && NUM_PRIMARY_MIRROR_PAIRS='${{ matrix.num_primary_mirror_pairs }}' SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh"; then
echo "::error::Demo cluster creation failed"
exit 1
fi
Expand Down Expand Up @@ -1343,7 +1307,7 @@ jobs:
MAKE_DIRECTORY='-C $dir' \
PGOPTIONS='${PG_OPTS}' \
SRC_DIR='${SRC_DIR}' \
${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/test-cloudberry.sh" \
${SRC_DIR}/devops/build/automation/cloudberry/scripts/test-cloudberry.sh" \
2>&1 | tee "$config_log"; then
echo "::warning::Test execution failed for configuration $((i+1)): make -C $dir $target"
overall_status=1
Expand Down Expand Up @@ -1376,7 +1340,7 @@ jobs:
ls -Rl "/tmp/cloudberry-cores"
echo "-----------------------------------------"

"${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/analyze_core_dumps.sh "$test_id"
"${SRC_DIR}"/devops/build/automation/cloudberry/scripts/analyze_core_dumps.sh "$test_id"
core_analysis_rc=$?
case "$core_analysis_rc" in
0) echo "No core dumps found for this configuration" ;;
Expand Down Expand Up @@ -1452,7 +1416,7 @@ jobs:
# Parse this configuration's results

MAKE_NAME="${{ matrix.test }}-config$i" \
"${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/parse-test-results.sh "$config_log"
"${SRC_DIR}"/devops/build/automation/cloudberry/scripts/parse-test-results.sh "$config_log"
status_code=$?

{
Expand Down
62 changes: 13 additions & 49 deletions .github/workflows/build-dbg-cloudberry.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -343,24 +343,6 @@ jobs:
fetch-depth: 1
submodules: true

- name: Checkout CI Build/Test Scripts
if: needs.check-skip.outputs.should_skip != 'true'
uses: actions/checkout@v4
with:
repository: apache/cloudberry-devops-release
ref: main
path: cloudberry-devops-release
fetch-depth: 1

- name: Move cloudberry-devops-release directory
if: needs.check-skip.outputs.should_skip != 'true'
run: |
set -eo pipefail
if ! mv "${GITHUB_WORKSPACE}"/cloudberry-devops-release "${GITHUB_WORKSPACE}"/..; then
echo "::error::Container initialization failed"
exit 1
fi

- name: Cloudberry Environment Initialization
if: needs.check-skip.outputs.should_skip != 'true'
env:
Expand Down Expand Up @@ -412,8 +394,8 @@ jobs:
SRC_DIR: ${{ github.workspace }}
run: |
set -eo pipefail
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/configure-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ENABLE_DEBUG=${{ env.ENABLE_DEBUG }} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/configure-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/configure-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ENABLE_DEBUG=${{ env.ENABLE_DEBUG }} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/configure-cloudberry.sh"; then
echo "::error::Configure script failed"
exit 1
fi
Expand All @@ -425,8 +407,8 @@ jobs:
run: |
set -eo pipefail

chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/build-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/build-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/build-cloudberry.sh"; then
echo "::error::Build script failed"
exit 1
fi
Expand Down Expand Up @@ -508,7 +490,7 @@ jobs:
# Create RPM
echo "Creating RPM package..."
rpmdev-setuptree
ln -s "${SRC_DIR}"/../cloudberry-devops-release/packaging/rpm/el/SPECS/apache-cloudberry-db-incubating.spec "${HOME}"/rpmbuild/SPECS/apache-cloudberry-db-incubating.spec
ln -s "${SRC_DIR}"/devops/build/packaging/rpm/apache-cloudberry-db-incubating.spec "${HOME}"/rpmbuild/SPECS/apache-cloudberry-db-incubating.spec
cp "${SRC_DIR}"/LICENSE /usr/local/cloudberry-db

DEBUG_RPMBUILD_OPT=""
Expand All @@ -518,7 +500,7 @@ jobs:
DEBUG_IDENTIFIER=".debug"
fi

"${SRC_DIR}"/../cloudberry-devops-release/scripts/build-rpm.sh --version "${CBDB_VERSION}" --release "${BUILD_NUMBER}" "${DEBUG_RPMBUILD_OPT}"
"${SRC_DIR}"/devops/build/packaging/rpm/build-rpm.sh --version "${CBDB_VERSION}" --release "${BUILD_NUMBER}" "${DEBUG_RPMBUILD_OPT}"

# Get OS version and move RPM
os_version=$(grep -oP '(?<=^VERSION_ID=")[0-9]' /etc/os-release)
Expand Down Expand Up @@ -553,8 +535,8 @@ jobs:
SRC_DIR: ${{ github.workspace }}
run: |
set -eo pipefail
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/unittest-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/unittest-cloudberry.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/unittest-cloudberry.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/unittest-cloudberry.sh"; then
echo "::error::Unittest script failed"
exit 1
fi
Expand Down Expand Up @@ -804,24 +786,6 @@ jobs:
run: |
echo "Timestamp from output: ${{ needs.build.outputs.build_timestamp }}"

- name: Checkout CI Build/Test Scripts
if: needs.check-skip.outputs.should_skip != 'true'
uses: actions/checkout@v4
with:
repository: apache/cloudberry-devops-release
ref: main
path: cloudberry-devops-release
fetch-depth: 1

- name: Move cloudberry-devops-release directory
if: needs.check-skip.outputs.should_skip != 'true'
run: |
set -eo pipefail
if ! mv "${GITHUB_WORKSPACE}"/cloudberry-devops-release "${GITHUB_WORKSPACE}"/..; then
echo "::error::Container initialization failed"
exit 1
fi

- name: Cloudberry Environment Initialization
env:
LOGS_DIR: build-logs
Expand Down Expand Up @@ -1167,8 +1131,8 @@ jobs:
set -eo pipefail

{
chmod +x "${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && NUM_PRIMARY_MIRROR_PAIRS='${{ matrix.num_primary_mirror_pairs }}' SRC_DIR=${SRC_DIR} ${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh"; then
chmod +x "${SRC_DIR}"/devops/build/automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh
if ! time su - gpadmin -c "cd ${SRC_DIR} && NUM_PRIMARY_MIRROR_PAIRS='${{ matrix.num_primary_mirror_pairs }}' SRC_DIR=${SRC_DIR} ${SRC_DIR}/devops/build/automation/cloudberry/scripts/create-cloudberry-demo-cluster.sh"; then
echo "::error::Demo cluster creation failed"
exit 1
fi
Expand Down Expand Up @@ -1239,7 +1203,7 @@ jobs:
MAKE_DIRECTORY='-C $dir' \
PGOPTIONS='${PG_OPTS}' \
SRC_DIR='${SRC_DIR}' \
${SRC_DIR}/../cloudberry-devops-release/build_automation/cloudberry/scripts/test-cloudberry.sh" \
${SRC_DIR}/devops/build/automation/cloudberry/scripts/test-cloudberry.sh" \
2>&1 | tee "$config_log"; then
echo "::warning::Test execution failed for configuration $((i+1)): make -C $dir $target"
overall_status=1
Expand Down Expand Up @@ -1272,7 +1236,7 @@ jobs:
ls -Rl "/tmp/cloudberry-cores"
echo "-----------------------------------------"

"${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/analyze_core_dumps.sh "$test_id"
"${SRC_DIR}"/devops/build/automation/cloudberry/scripts/analyze_core_dumps.sh "$test_id"
core_analysis_rc=$?
case "$core_analysis_rc" in
0) echo "No core dumps found for this configuration" ;;
Expand Down Expand Up @@ -1348,7 +1312,7 @@ jobs:
# Parse this configuration's results

MAKE_NAME="${{ matrix.test }}-config$i" \
"${SRC_DIR}"/../cloudberry-devops-release/build_automation/cloudberry/scripts/parse-test-results.sh "$config_log"
"${SRC_DIR}"/devops/build/automation/cloudberry/scripts/parse-test-results.sh "$config_log"
status_code=$?

{
Expand Down
Loading
Loading