Skip to content
@ewoks-kit

ewoks-kit

Ewoks development organisation

Extensible Workflow System: Core Projects

Ewoks is a framework for automating data processing and experiments at large-scale facilities in a reproducible, traceable, and portable manner.

It is a meta workflow system that can execute the same computation graph using different workflow management systems.

Repositories

flowchart LR
ewoksweb["ewoksweb (Web UI)"]
ewoksserver["ewoksserver (REST backend)"]
ewoksjob["ewoksjob (Client)"]
ewoksjobworker["ewoksjob (Worker)"]
ewoks["ewoks (API / CLI)"]
ewokscore["ewokscore (Core engine & runtime)"]
ewoksdask["ewoksdask"]
ewoksppf["ewoksppf"]
ewoksorange["ewoksorange"]
%% User interaction
ewoksweb --> ewoksserver
%% Submission path
ewoksserver --> ewoksjob
ewoksjob --> ewoksjobworker
%% Execution
ewoksjobworker --> ewoks
ewoks --> ewokscore
ewoks --> ewoksdask
ewoks --> ewoksppf
ewoks --> ewoksorange
Loading

Workflow Engines

  • ewokscore: basic engine for sequential execution.
  • ewoksdask: engine for distributed execution.
  • ewoksppf: engine that supports loops and conditional links.
  • ewoksorange: engine with a desktop graphical user interface.

Engines can be created by anyone. The ewoks package can discover all engines installed in the same python environment.

Workflow Management

  • ewoksjob: Job scheduling system
    • client: submit workflows (no ewoks installation required)
    • worker: execute workflows (ewoks installed)
  • ewoksutils: Shared utilities used by ewoks, ewokscore, and ewoksjob on both client and worker sides.
  • ewoksweb: web frontend for workflow creation and execution.
  • ewoksserver: REST server for workflow creation and execution.

Development and Operations

Popular repositories Loading

  1. ewoks ewoksPublic

    Extensible Workflow System

    Python 3 1

  2. ewoksutils ewoksutilsPublic

    Utilities for ewoks developers

    Python 3

  3. ewokscore ewokscorePublic

    API for graphs and tasks in Ewoks

    Python 1 1

  4. .github .githubPublic

    ewoks-kit organization management

    Python

  5. ewokswhale ewokswhalePublic

    Ewoks Docker application

    Python

  6. ewoksdraw ewoksdrawPublic

    Render Ewoks workflows as SVG

    Python

Repositories

Showing 10 of 14 repositories

Top languages

Loading…

Most used topics

Loading…