Skip to content

Conversation

@Gilbert09
Copy link
Member

Changes

  • Use increased timeout/retry limits for append syncs

@Gilbert09 Gilbert09 requested review from a team and Copilot November 27, 2025 16:27
Copilot finished reviewing on behalf of Gilbert09 November 27, 2025 16:28
Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 files reviewed, no comments

Edit Code Review Agent Settings | Greptile

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR extends increased timeout and retry limits to append-type syncs in addition to incremental syncs. Previously, only incremental syncs received extended timeouts (1 week timeout, 9 retry attempts), while append syncs used the default limits (24 hours timeout, 3 retry attempts).

  • Updated the return value from create_external_data_job_model_activity to include both incremental and append sync types
  • Renamed the incremental variable to incremental_or_append for clarity in the workflow
  • Modified the timeout parameter selection logic to apply extended limits for both incremental and append syncs

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
posthog/temporal/data_imports/workflow_activities/create_job_model.py Updated return value to check both is_incremental and is_append flags
posthog/temporal/data_imports/external_data_job.py Renamed variable to incremental_or_append and updated conditional logic to apply extended timeout limits for append syncs

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

)

return str(job.id), schema.is_incremental, source.source_type
return str(job.id), schema.is_incremental or schema.is_append, source.source_type
Copy link

Copilot AI Nov 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider using the existing schema.should_use_incremental_field property instead of schema.is_incremental or schema.is_append. The model already defines this property (line 90-91 in external_data_schema.py) with the same logic, which would improve consistency and maintainability.

Suggested change
return str(job.id), schema.is_incremental or schema.is_append, source.source_type
return str(job.id), schema.should_use_incremental_field, source.source_type

Copilot uses AI. Check for mistakes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants