Execution Functions

The core execution functions for running on a node.

The fundamental design of the core is to run a task composed of trays and modules. The general heirarchy looks like:

task
|
|- tray1
   |
   |- module1
   |
   |- module2
|
|- tray2
   |
   |- module3
   |
   |- module4

Parameters can be defined at every level, and each level is treated as a scope (such that inner scopes inherit from outer scopes). This is accomplished via an internal evironment for each scope.

Data movement should be defined at the task level.

Environment Functions

The internal IceProd environment, designed to be nested and clean up after itself.

Run Functions

The main execution flow goes through here.

Object Setup

Download/upload and setup the main IceProd objects (Resources, Data, Classes).

iceprod.core.exe.downloadData(data: dict, cfg: ConfigParser, logger=None) Data | None[source]

Parse download url and local filename.

Parameters:
  • data – data config object

  • cfg – config parser

Returns:

either None or a Data object

iceprod.core.exe.uploadData(data: dict, cfg: ConfigParser, logger=None) Data | None[source]

Parse download url and local filename.

Parameters:
  • data – data config object

  • cfg – config parser

Returns:

either None or a Data object