JIT Compilation

[brandtbucher]

It's probably about time to start thinking seriously about just-in-time compilation. To kick things off, here's my talk from this year's sprint about "copy-and-patch", which I think is a really promising path forward: https://youtu.be/HxSHIpEQRjs

I'll also be opening a draft PR for discussion soon.

Linked PRs

• GH-113464: A copy-and-patch JIT compiler #113465
• GH-113464: Make myself a codeowner for JIT stuff #114739
• GH-113464: Add aarch64-apple-darwin/clang to JIT CI #114759
• GH-113464: Clean up JIT stencil generation #115800
• GH-113464: Add a warning when building the JIT #118481
• GH-113464: Generate a more efficient JIT #118512
• GH-113464: Remove the extra jump via _SIDE_EXIT in _EXIT_TRACE #118545
• GH-113464: Run the JIT interpreter before any other JIT CI #119466
• [3.13] GH-113464: Run the JIT interpreter before any other JIT CI (GH-119466) #119490
• GH-113464: Speed up JIT builds #122839
• GH-113464: Get LLVM from cpython-bin-deps on Windows #133278
• GH-113464: Add the JIT to What's New #133486

[cosmicexplorer]

Do you have a writeup or other non-video explainer available, or is the PR itself the best reference for this technique?

[MarshalX]

Do you have a writeup or other non-video explainer available, or is the PR itself the best reference for this technique?

Maybe this one will be helpful to you https://aha.stanford.edu/sites/g/files/sbiybj20066/files/media/file/aha_050621_xu_copy-and-patch.pdf

[brandtbucher]

Do you have a writeup or other non-video explainer available, or is the PR itself the best reference for this technique?

There four main resources that I've been directing people towards... they each explain different things in different levels of detail:

• The white paper: high-level overview of copy-and-patch.
• The blog post: low-level implementation details for copy-and-patch.
• The YouTube video: high-level overview of CPython's approach to copy-and-patch.
• The pull request: low-level implementation details for CPython's approach to copy-and-patch.

[brandtbucher]

Done! I'll be opening follow-up issues for further improvements to both the build process and the generated code.