Streaming ndjson parser and metrics aggregator for hyper-simulator
npm install hypersim-parserconst{ createReadStream }=require('fs')const{ BasicTimeline }=require('hypersim-parser')constparser=newBasicTimeline()// Register a custom aggregatorparser.pushReducer('version',(prev,{ type, event, seq })=>{if(type!=='custom'&&event!=='block')return0returnseq})// 'snapshot' event is emitted once for each tick in the simulation's timelineparser.once('snapshot',(snapshot,iteration)=>{console.log(snapshot)snapshot.version// contains the result the custom reducer/aggregator.})// 'close' is fired once all events has been traversed.parser.once('close',()=>console.log('Parsing complete'))// The parser implements a Writable stream, and accepts// ndjson in chunks of Buffer | Uint8Array | stringconstreadable=fs.createReadStream('swarm-log.json')readable.pipe(parser)Ideas and contributions to the project are welcome. You must follow this guideline.
GNU AGPLv3 © Tony Ivanov