← all conversations

Query Service for Qwen Coder

2025-03-082 turns1,750 charsgpt-4o
llm-api-servicesopenrouterqwen-coder

Summary

User seeks cloud API providers for Qwen Coder to avoid slow local inference speeds.

Messages

could you use openrouter.io for this: I know the local model's token/sec is terribly low. It is like 3 for me with a mid-range AMD GPU and 64GB ram. Just wondering is there any provider that offers query as a service for open source models like Qwen Coder, to plug to vscode?
Yes, there are several providers that offer Qwen Coder as a service, which you can integrate into your development environment, such as Visual Studio Code (VSCode). This approach can help you overcome the limitations of local model performance. Here are some options: :::contextList 【{"image_fetch": "OpenRouter AI logo"}】 **OpenRouter** OpenRouter provides access to Qwen2.5-Coder-32B-Instruct, a state-of-the-art code-specific large language model. You can utilize their API to integrate this model into your applications, including VSCode. citeturn0search1 ::: :::contextList 【{"image_fetch": "DeepInfra logo"}】 **DeepInfra** DeepInfra offers the Qwen2.5-Coder-7B model, designed for code generation, reasoning, and fixing tasks across 92 programming languages. Their API supports integration with various development tools. citeturn0search2 ::: :::contextList 【{"image_fetch": "Together AI logo"}】 **Together AI** Together AI provides access to the Qwen 2.5 Coder 32B Instruct model, which supports advanced code generation and reasoning with a context length of up to 128K tokens. Their API enables seamless integration into development environments. citeturn0search4 ::: To integrate these services into VSCode, you can use extensions or plugins that allow API calls to these providers. This setup enables you to leverage powerful code generation and assistance capabilities without relying solely on local hardware resources.
gpt-4o