Skip to content

Conversation

@kevinrue
Copy link
Collaborator

  1. concatenate the tables and write the result to a compressed text file (cluster job)
  2. load to database (head node)

@snsansom
Copy link
Collaborator

Hi Kevin,

This looks good - as you proposed we should also add the active_if statements so that loading of results to the database can be disabled for large samples.

Best wishes,
Steve

@kevinrue
Copy link
Collaborator Author

The last commit seems to have taken care of it on my side, tested on a project. Perhaps you want to test it yourself on a toy project to double check before merging?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants