If you want to have more information on AI Endpoints, please read the following blog post.
You can, also, have a look at our previous blog posts on how use AI Endpoints.
Also, be sure to check out this blog post about deploying Coder on the OVHcloud Managed Kubernetes Service.
In the field of the code assistant a lot of solutions exist.
However, you should want to create your own assistant to master your configuration and to have a better control on your data.
Continue will help you in this task.
In a nutshell, Continue is an IDE plugin to build your own code assistant.
At the time of writing this blog post, Continue is compatible with VSCode and JetBrains IDE.
The great strength of Continue is that it allows to use a custom LLM endpoints and, yes, AI Endpoints works with Continue 😎.
Continue installation
Continue come as a plugin, it's very simple to install, please follow the official documentation.
Note that when you install Continue for one IDE, the settings are shared for the other IDE.
Continue settings with AI Endpoints
Once continue is installed, you can set it up with AI Endpoints.
Continue has two major configurations, one for the chatbot tool and another one for the tab completion tool.
To add the configurations, open the YAML configuration file and set it up as follow:
name: ide-configuration
version: 0.0.1
schema: v1
models:
- name: Meta-Llama-3_3-70B-Instruct
provider: openai
model: Meta-Llama-3_3-70B-Instruct
apiBase: https://llama-3-3-70b-instruct.endpoints.kepler.ai.cloud.ovh.net/api/openai_compat/v1
apiKey: <your AI Endpoint API key>
roles:
- chat
- name: Qwen3-Coder-30B-A3B-Instruct
provider: openai
model: Qwen3-Coder-30B-A3B-Instruct
apiBase: https://qwen-3-coder-30b-a3b-instruct.endpoints.kepler.ai.cloud.ovh.net/api/openai_compat/v1
apiKey: <your AI Endpoint API key>
roles:
- chatFor the chatbot tool you can set several models, try them and choose the one that fit the best to your needs 😊.
Here is an example of configuration for auto complete feature:
- name: Qwen3-Coder-30B-A3B-Instruct
provider: openai
model: Qwen3-Coder-30B-A3B-Instruct
apiBase: https://qwen-3-coder-30b-a3b-instruct.endpoints.kepler.ai.cloud.ovh.net/api/openai_compat/v1
apiKey: <your AI Endpoint API key>
roles:
- autocompleteAs you see you can define only one model for the tab completion feature, you can choose any of the Code LLM section from AI Endpoints.
It's time to test it!
The chatbot tool.
The tab completion tool.
Don’t hesitate to test our new product, AI Endpoints, and give us your feedback.
You have a dedicated Discord channel (#ai-endpoints) on our Discord server (https://discord.gg/ovhcloud), see you there!