pulsar.managers.staging package

Submodules

pulsar.managers.staging.post module

pulsar.managers.staging.post.postprocess(job_directory, action_executor, was_cancelled)

pulsar.managers.staging.post.realized_dynamic_file_sources(job_directory)

pulsar.managers.staging.pre module

pulsar.managers.staging.pre.preprocess(job_directory, setup_actions, action_executor, was_cancelled, object_store=None)

Module contents

This module contains the code that allows the Pulsar to stage file’s during preprocessing (currently this means downloading or copying files) and then unstage or send results back to client during postprocessing.

pulsar.managers.staging.postprocess(job_directory, action_executor, was_cancelled)

pulsar.managers.staging.preprocess(job_directory, setup_actions, action_executor, was_cancelled, object_store=None)

pulsar.managers.staging.realized_dynamic_file_sources(job_directory)