Skip to content

Jupyter Scheduler Not Saving Output Files in JupyterHub Environment #592

@Acel05

Description

@Acel05

Description

When using the JupyterLab Job Scheduler in a JupyterHub environment, my job executes successfully without errors, but the output CSV/Excel files are not being saved or updated. The same code works perfectly when run manually within a notebook, but the scheduler doesn't properly save the output files.

How to reproduce

  1. Create a notebook that generates CSV/Excel output files
  2. Run the notebook manually - files are created/updated correctly
  3. Submit the same notebook as a job through JupyterLab Job Scheduler
  4. Job completes successfully with no errors
  5. The output files are either not created at all or not updated

Expected behavior

When a job is run through the JupyterLab Job Scheduler:

  1. If the output file doesn't exist yet, it should be created
  2. If the output file already exists, it should be overwritten with new data
  3. Files should be saved in a predictable location (ideally in a job_output/project_name/ directory structure)

Context

  1. Operating System: Linux (Running in JupyterHub container)
  2. JupyterLab version: latest
  3. Jupyter Scheduler version: latest
  4. Environment: JupyterHub with multiple users

The job scheduler configuration appears to be missing proper file handling settings. The jobs execute successfully, but the file output operations don't work as expected, despite the same code working when run manually.

I've tried various settings in the job scheduler configuration but haven't found the right combination to make it save files properly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions