All issues

Search results

我这个CPU可以跑大模型吗？

Status: Open.

#521In intel/xFasterTransformer;

· li5bo5 opened on Jun 30, 2025

build_async_engine_client_from_engine_args cannot import

Status: Open.

#516In intel/xFasterTransformer;

· Jasonjunsu opened on May 29, 2025

Which instruction set will the CPU use?

Status: Open.

#515In intel/xFasterTransformer;

· Light-Travlling opened on May 23, 2025

undefined reference to Qwen2LLM

Status: Open.

#514In intel/xFasterTransformer;

· Jasonjunsu opened on May 23, 2025

why benchmark choose create multi process to test performance metrix?

Status: Open.

#511In intel/xFasterTransformer;

· Light-Travlling opened on May 13, 2025

how benchmark compute the multi process proformance?

Status: Open.

#510In intel/xFasterTransformer;

· Light-Travlling opened on May 12, 2025

1st token latency has poor performance than other framework

Status: Open.

#509In intel/xFasterTransformer;

· Light-Travlling opened on May 10, 2025

Got a wrong result with DeepSeek-Distill-Qwen-7b while running vllm serving with OMP_NUM_THREADS=16

Status: Open.

#491In intel/xFasterTransformer;

· shanzhou2186 opened on Feb 18, 2025

[Feature] Support Medusa decode (Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads)

Status: Open.

#489In intel/xFasterTransformer;

· yimuu opened on Jan 24, 2025

Older gcc support

Status: Open.

#486In intel/xFasterTransformer;

· Nor7th opened on Dec 5, 2024

qwen2.5 run error

Status: Open.

#482In intel/xFasterTransformer;

· wzg-zhuo opened on Oct 30, 2024

Qwen2.5-0.5B-Instruct quantization with gptq error

Status: Open.

#480In intel/xFasterTransformer;

· wcollin opened on Oct 14, 2024