Skip to content

Add local-only LM Studio model profile (local.json) - #150

Merged
neoneye merged 1 commit into
PlanExeOrg:mainfrom
VoynichLabs:lmstudio-local-profile
Mar 7, 2026
Merged

Add local-only LM Studio model profile (local.json)#150
neoneye merged 1 commit into
PlanExeOrg:mainfrom
VoynichLabs:lmstudio-local-profile

Conversation

@82deutschmark

Copy link
Copy Markdown
Collaborator

This PR adds a clean, local-only LM Studio model profile for PlanExe.

What it does

  • Provides a dedicated local.json configuration file for LM Studio-based local models
  • Includes both primary and fallback model configurations using the LMStudio class

Why context_window and num_output matter

The llama_index library uses conservative defaults for context_window (3900 tokens) and num_output (256 tokens) that can silently truncate prompts for local models. This profile explicitly sets:

  • context_window: 32768 — prevents silent truncation of long prompts
  • num_output: 4096 — allows for more detailed responses

These settings ensure that local models receive complete prompts and can generate fuller responses without the underlying llama_index framework silently cutting content.

Reference

@neoneye
neoneye merged commit 60a3ea5 into PlanExeOrg:mainMar 7, 2026
3 checks passed
@neoneye
neoneye deleted the lmstudio-local-profile branch March 7, 2026 19:28
huangyingting pushed a commit to repomesh/PlanExe that referenced this pull request Jun 26, 2026
Resolves Dependabot security alerts in worker_plan/pyproject.toml by bumping to the first stable patched release of each package:
- aiohttp 3.13.5 -> 3.14.1 (alerts PlanExeOrg#152,PlanExeOrg#153,PlanExeOrg#156-PlanExeOrg#164)
- tornado 6.5.4 -> 6.5.7 (alerts PlanExeOrg#113,PlanExeOrg#114,PlanExeOrg#136,PlanExeOrg#155,PlanExeOrg#165,PlanExeOrg#166,PlanExeOrg#171)
- python-multipart 0.0.22 -> 0.0.32 (alerts PlanExeOrg#142,PlanExeOrg#149,PlanExeOrg#167-PlanExeOrg#170)
- urllib3 2.6.3 -> 2.7.0 (alerts PlanExeOrg#150,PlanExeOrg#151)
- marshmallow 3.24.2 -> 3.26.2 (alert PlanExeOrg#81), staying on 3.x to avoid the breaking 4.x major
transformers alert PlanExeOrg#137 is excluded: its only fix is the 5.x major line and the vulnerable Trainer class is never imported by PlanExe (handled separately).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@82deutschmark@neoneye