made it possible to create a TokenList from a buffer

[firewave]

No description provided.

[firewave]

Still need to integrate/test it with #261 to make sure it does not introduce any issues.

It is already actively used by Macro though and no tests are failing, so it should be fine.

[firewave]

Some tests are still failing - will investigate.

[firewave]

The tests failing are the ones with binary characters in the string. We need to add an additional const char*, int input for those.

[firewave]

I changed it from a std::string input to a const unsigned char*, std::size_t and const char*, std::size_t (for convienience).

The tests pass but it produces valgrind failures in #261.

[firewave]

The tests pass but it produces valgrind failures in #261.

The issue has been fixed - see https://github.com/danmar/simplecpp/actions/runs/8484373804/job/23247192053?pr=261.

[firewave]

I will provide a downstream PR which shows this is working within Cppcheck.

We should also do the (planned) release before merging this.

[danmar]

@firewave would you like that I release simplecpp now or do you have some more fixes..?

[firewave]

@firewave would you like that I release simplecpp now or do you have some more fixes..?

Do the release so we are in proper sync again.

Afterwards this PR, #339 and #312 require your feedback - and some minor work from my side.

[firewave]

These checks are still a hot spot. No idea if there is a way to implement this in a more performant way.

[firewave]

Here is the downstream PR using char buffers instead of streams: cppcheck-opensource/cppcheck#6379.

[firewave]

Ready for review since the downstream PR passes all tests.

[danmar]

lgtm

[danmar]

@firewave you should have gotten an invite for this project. I hope you can merge..

[firewave]

you should have gotten an invite for this project. I hope you can merge..

@danmar Thanks.