data_pipe

Features

Cross Thread Message Pipe:

• lock-free
• thread-safe
• exponential-back-off

Message Transfer End Points:

• any combination of: sync, trio, curio, asyncio

Benchmark

Performance on local CPU:

cross-thread

sync -> sync @ 1.0 micros/object
sync -> curio @ 5.0 micros/object
sync -> asyncio @ 6.0 micros/object
sync -> trio @ 7.0 micros/object

cross-process

sync -> sync @ 0.5 micros/object
sync -> curio @ 0.7 micros/object
sync -> asyncio @ 0.7 micros/object
sync -> trio @ 0.7 micros/object

Install

To install python package:

sudo pip install data_pipe

Usage

cross-process, cross-framework rpc:

• basic_trunk.py
• basic_trunk_test.py

cross-process, cross-framework queue:

• native_ruptor.pyx
• any_ruptor_perf.py