⚡ Bolt: [performance improvement] Memoize NLP Lexicons & Regex Compilation - #30
⚡ Bolt: [performance improvement] Memoize NLP Lexicons & Regex Compilation#30zrt219 wants to merge 1 commit into
Conversation
…ocument processing performance. This adds `@functools.lru_cache` to `_compiled_context_lexicon`, `_alias_lookups`, and `_aliases_for_language` in `openmed.clinical` as these deterministic lexicons were previously constructed and regex-compiled repeatedly per-document or per-span during text processing. Co-authored-by: zrt219 <199104500+zrt219@users.noreply.github.com>
The latest updates on your projects. Learn more about Vercel for GitHub.
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with New to Jules? Learn more at jules.google/docs. For security, I will only act on instructions from the user who triggered this task. |
💡 What: Memoized deterministic NLP regex compilation and lexicon alias mapping lookups within the
openmed.clinicalcontext and section detectors. Addedtypes.MappingProxyTypeto ensure immutability of returned dicts in cached calls.🎯 Why: Functions like
_compiled_context_lexiconand_aliases_for_languagewere being invoked repeatedly inside document processing loops, resulting in major redundant CPU overhead (e.g., repeatedly recompiling 12+ regex patterns per evaluation).📊 Impact: Expected near 100% reduction in compilation overhead for subsequent lexicon evaluations across documents, improving throughput without architectural changes.
🔬 Measurement: Execute any downstream text processing benchmark, or verify unit tests successfully complete faster. You can run
cd openmed && uv run pytest tests/unit/clinicalto confirm zero regressions.PR created automatically by Jules for task 6224318581904605425 started by @zrt219