Query Service for Qwen Coder
2025-03-082 turns1,750 charsgpt-4o
Summary
User seeks cloud API providers for Qwen Coder to avoid slow local inference speeds.
Messages
could you use openrouter.io for this: I know the local model's token/sec is terribly low. It is like 3 for me with a mid-range AMD GPU and 64GB ram. Just wondering is there any provider that offers query as a service for open source models like Qwen Coder, to plug to vscode?
Yes, there are several providers that offer Qwen Coder as a service, which you can integrate into your development environment, such as Visual Studio Code (VSCode). This approach can help you overcome the limitations of local model performance. Here are some options:
:::contextList
【{"image_fetch": "OpenRouter AI logo"}】
**OpenRouter**
OpenRouter provides access to Qwen2.5-Coder-32B-Instruct, a state-of-the-art code-specific large language model. You can utilize their API to integrate this model into your applications, including VSCode. citeturn0search1
:::
:::contextList
【{"image_fetch": "DeepInfra logo"}】
**DeepInfra**
DeepInfra offers the Qwen2.5-Coder-7B model, designed for code generation, reasoning, and fixing tasks across 92 programming languages. Their API supports integration with various development tools. citeturn0search2
:::
:::contextList
【{"image_fetch": "Together AI logo"}】
**Together AI**
Together AI provides access to the Qwen 2.5 Coder 32B Instruct model, which supports advanced code generation and reasoning with a context length of up to 128K tokens. Their API enables seamless integration into development environments. citeturn0search4
:::
To integrate these services into VSCode, you can use extensions or plugins that allow API calls to these providers. This setup enables you to leverage powerful code generation and assistance capabilities without relying solely on local hardware resources.
gpt-4o