Skip to content

Conversation

darynaishchenko
Copy link
Collaborator

What

resolves: https://github.com/airbytehq/airbyte-internal-issues/issues/14340

How

Review guide

User Impact

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

@github-actions
Copy link
Contributor

👋 Greetings, Airbyte Team Member!

Here are some helpful tips and reminders for your convenience.

Helpful Resources

PR Slash Commands

Airbyte Maintainers (that's you!) can execute the following slash commands on your PR:

  • /format-fix - Fixes most formatting issues.
  • /update-connector-cdk-version connector=<CONNECTOR_NAME> - Updates the specified connector to the latest CDK version.
    Example: /update-connector-cdk-version connector=destination-bigquery
  • /bump-version - Bumps connector versions.
    • You can specify a custom changelog by passing changelog. Example: /bump-version changelog="My cool update"
    • Leaving the changelog arg blank will auto-populate the changelog from the PR title.
  • /run-cat-tests - Runs legacy CAT tests (Connector Acceptance Tests)
  • /build-connector-images - Builds and publishes a pre-release docker image for the modified connector(s).
  • /poe connector source-example lock - Run the Poe lock task on the source-example connector, committing the results back to the branch.
  • /poe source example lock - Alias for /poe connector source-example lock.
  • /poe source example use-cdk-branch my/branch - Pin the source-example CDK reference to the branch name specified.
  • /poe source example use-cdk-latest - Update the source-example CDK dependency to the latest available version.

📝 Edit this welcome message.

@darynaishchenko
Copy link
Collaborator Author

darynaishchenko commented Sep 24, 2025

/format-fix

Format-fix job started... Check job output.

✅ Changes applied successfully. (2247047)

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@github-actions
Copy link
Contributor

github-actions bot commented Sep 24, 2025

Deploy preview for airbyte-docs ready!

✅ Preview
https://airbyte-docs-a2x4imrh2-airbyte-growth.vercel.app

Built with commit c5e5ca1.
This pull request is being automatically deployed with vercel-action

@github-actions
Copy link
Contributor

github-actions bot commented Sep 24, 2025

source-gcs Connector Test Results

40 tests   34 ✅  36s ⏱️
 2 suites   6 💤
 2 files     0 ❌

Results for commit c5e5ca1.

♻️ This comment has been updated with latest results.

@darynaishchenko
Copy link
Collaborator Author

darynaishchenko commented Sep 25, 2025

Regression tests:

local run as gha wasn't able to find connections

image
  • itest_catalog_are_the_same: s_file_based field added to catalog
  • TestDataIntegrity.test_all_records_are_the_same_without_state: diff for _ab_source_file_url field as source creates signed url every time that can be different

GHA: https://github.com/airbytehq/airbyte/actions/runs/18012486891

@darynaishchenko darynaishchenko requested a review from a team September 25, 2025 12:15
@darynaishchenko darynaishchenko changed the title chor(source-gcs) update to airbyte-cdk v7 chore(source-gcs) update to airbyte-cdk v7 Sep 29, 2025
Copy link
Contributor

@maxi297 maxi297 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a concern regarding code duplication that I hope would facilitate our upcoming work. WDYT?

@darynaishchenko
Copy link
Collaborator Author

regression tests:
https://github.com/airbytehq/airbyte/actions/runs/18278593023/job/52036245449
itest_catalog_are_the_same: is_file_based field added to catalog

Copy link
Contributor

@maxi297 maxi297 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome! Thanks for adding leverage to the CDK. It looks clean in the source without duplication

Copy link
Contributor

@aldogonzalez8 aldogonzalez8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

APPROVED
Thanks for improving this.

Comment on lines +74 to +84
delivery_method: Union[DeliverRecords, DeliverRawFiles] = Field(
title="Delivery Method",
discriminator="delivery_type",
type="object",
order=3,
display_type="radio",
group="advanced",
default="use_records_transfer",
airbyte_hidden=True,
)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Comment on lines +60 to +81
def __init__(self, blob: Any, displayed_uri: str = None, **kwargs):
super().__init__(**kwargs)
self.blob = blob
self.displayed_uri = displayed_uri
self.id = self.blob.id
self.created_at = self.blob.time_created.strftime("%Y-%m-%dT%H:%M:%S.%fZ")
self.updated_at = self.blob.updated.strftime("%Y-%m-%dT%H:%M:%S.%fZ")

@property
def size(self) -> int:
return self.blob.size

def download_to_local_directory(self, local_file_path: str) -> None:
self.blob.download_to_filename(local_file_path)

@property
def source_file_relative_path(self) -> str:
return urllib.parse.unquote(self.blob.path)

@property
def file_uri_for_logging(self) -> str:
return urllib.parse.unquote(self.blob.path)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@darynaishchenko darynaishchenko merged commit 36a1f95 into master Oct 6, 2025
33 of 34 checks passed
@darynaishchenko darynaishchenko deleted the daryna/source-gcs/update-to-7-cdk branch October 6, 2025 15:10
matteogp pushed a commit that referenced this pull request Oct 10, 2025
Co-authored-by: Octavia Squidington III <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Aymericcst pushed a commit to Aymericcst/airbyte that referenced this pull request Oct 13, 2025
Co-authored-by: Octavia Squidington III <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants