Is it possible to stream data through the json parser without storing everything in memory?

[anden259]

Is it possible to stream data through the json parser without storing everything in memory?

Lets say I have a json file that is 10 GB, is it possible to stream that through the parser without storing it in memory?

Something like:
file stream >> json deserialze >> data stream

and the reverse:
data stream >> json serialize >> json string stream

Is that possible with this library?

[nlohmann]

What exactly would the library do in this setting?

[nlohmann]

You may want to have a look at the parser callback mechanism of the library:

• general documentation
• an example

It may not be 100% what you need, but maybe you can express your usecase in terms of such a callback function.

[nlohmann]

@anden259 Can I close this ticket?

[anden259]

@nlohmann I had a look through the docs, examples and source code. The current library does not support what I need, so I decided to write my own. It'll get published once it's more complete than it is at the moment. Thank you for your help. Feel free to close the ticket.