gh-116417: Add _testlimitedcapi C extension

[vstinner]

Add a new C extension "_testlimitedcapi" which is only built with the limited C API.

Move heaptype_relative.c and vectorcall_limited.c from Modules/_testcapi/ to Modules/_testlimitedcapi/.

• Issue: C API: Move limited C API tests from _testcapi to a new _testlimitedcapi extension #116417

[vstinner]

@erlend-aasland@encukou@sobolevn@colesbury: What do you think of this change? (See the issue for the rationale.)

[vstinner]

If we land this change, should we move tests which don't use the non-limited C API (tests only using the limited C API) to _testlimitedapi?

This change should be backported to 3.11 and 3.12 branches to ease backport of future changes.

[colesbury]

This seems like a good idea to me.

• The #include "pyconfig.h" can be removed from vectorcall_limited.c and heaptype_relative.c now that it's part of parts.h
• heaptype_relative.c can also remove the Py_LIMITED_API define now that it's defined in parts.h.

[zooba]

Can we remove xxlimited.c then? I'm pretty sure that's only in there to test the limited API, so if we have another module doing it, there isn't a need for that one.

[vstinner]

@colesbury:

This seems like a good idea to me. (...)

Fixed: nicely spotted for remaining code in heaptype_relative.c.

I had a lot of build issues to build the new C extension properly on Linux and Windows, and then I forgot these lines.

@zooba:

Can we remove xxlimited.c then? I'm pretty sure that's only in there to test the limited API, so if we have another module doing it, there isn't a need for that one.

I don't think that it's a test, but more an example to write code using the limited C API. I started with the comment:

/*Usethisfileasatemplatetostartimplementingamodulethatalsodeclaresobjecttypes. Alloccurrencesof 'Xxo' should be changed

cc @encukou

[vstinner]

@colesbury: I addressed your remarks and tests now pass. You can review the updated PR ;-)

[colesbury]

LGTM

[sobolevn]

This looks like a good idea, thank you!

[erlend-aasland]

I'd like it if you could create an entry for this module in configure.ac; that way it is easier to see if this module is enabled or not. Relevant output from sample ./configure and make invocations:

The following modules are *disabled* in configure script:
_ctypes_test _testbuffer _testcapi _testclinic _testclinic_limited _testexternalinspection
_testimportmultiple _testinternalcapi _testmultiphase _testsinglephase _xxtestfuzz xxsubtype 

checking for stdlib extension module _testcapi... disabled
checking for stdlib extension module _testclinic... disabled
checking for stdlib extension module _testclinic_limited... disabled
checking for stdlib extension module _testinternalcapi... disabled
checking for stdlib extension module _testbuffer... disabled
checking for stdlib extension module _testimportmultiple... disabled
checking for stdlib extension module _testmultiphase... disabled
checking for stdlib extension module _testsinglephase... disabled
checking for stdlib extension module _testexternalinspection... disabled

If you "hide" this new extension module behind the _testcapi module, it will not show up in these outputs.

[vstinner]

I'd like it if you could create an entry for this module in configure.ac; that way it is easier to see if this module is enabled or not.

Sure! It's done.

Example:

$ ./configure --disable-test-modules|grep testlimited
checking for stdlib extension module _testlimitedcapi... disabled

The test extension is now disabled as expected.

[erlend-aasland]

Thanks! On more nit :)

[erlend-aasland]

It's a nice change; it makes sense to have this as a separate test module IMO.

[vstinner]

Thanks for your helpful reviews! I merged my PR.

[vstinner]

Backporting this change to Python 3.12 looks non trivial, I get many conflicts:

Unmerged paths:
(use "git add <file>..." to mark resolution)
both modified: Lib/test/support/__init__.py
both modified: Lib/test/test_capi/test_misc.py
both modified: Modules/Setup.stdlib.in
both modified: Modules/_testcapi/parts.h
both modified: Modules/_testcapimodule.c
both modified: Modules/_testlimitedcapi/heaptype_relative.c
both modified: Modules/_testlimitedcapi/vectorcall_limited.c
both modified: PCbuild/pcbuild.proj
both modified: PCbuild/pcbuild.sln
both modified: PCbuild/readme.txt
both modified: Tools/c-analyzer/c_parser/preprocessor/gcc.py
both modified: Tools/msi/test/test_files.wxs
both modified: configure
both modified: configure.ac

The split of Modules/_testinternalcapi.c was not backported. Maybe we should not backport these changes to 3.11 and 3.12.