Skip to content

Commit c2831d7

Browse files
author
Your Name
committed
Update docs for litellm removal
1 parent d8d0c69 commit c2831d7

10 files changed

Lines changed: 25 additions & 96 deletions

File tree

cecli/website/docs/config/adv-model-settings.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ The json file should be a dictionary with an entry for each model, as follows:
4141
4242
### Contribute model metadata
4343

44-
Cecli relies on [litellm's model_prices_and_context_window.json file](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json) for model metadata.
44+
Cecli ships its own bundled model metadata in `cecli/resources/model-metadata.json` (see the file in the [cecli repository](https://github.com/cecli-dev/cecli/blob/main/cecli/resources/model-metadata.json)). It is based on LiteLLM's configuration scheme [here](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json).
4545

4646
Consider submitting a PR to that file to add missing models.
4747

@@ -62,9 +62,9 @@ If the files above exist, they will be loaded in that order. Files loaded last w
6262

6363
The YAML file should be a list of dictionary objects for each model.
6464

65-
### Passing extra params to litellm.completion
65+
### Passing extra params to model requests
6666

67-
The `extra_params` attribute of model settings is used to pass arbitrary extra parameters to the `litellm.completion()` call when sending data to the given model.
67+
The `extra_params` attribute of model settings is used to pass arbitrary extra parameters to cecli's completion dispatcher when sending data to the given model. These become request parameters sent to the provider API.
6868

6969
For example:
7070

@@ -76,7 +76,7 @@ For example:
7676
max_tokens: 8192
7777
```
7878
79-
You can use the special model name `cecli/extra_params` to define `extra_params` that will be passed to `litellm.completion()` for all models. Only the `extra_params` dict is used from this special model name.
79+
You can use the special model name `cecli/extra_params` to define `extra_params` that will be passed to cecli's completion dispatcher for all models. Only the `extra_params` dict is used from this special model name.
8080

8181
For example:
8282

cecli/website/docs/config/model-configuration.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,12 +16,12 @@ Cecli allows you to customize and override LLM configurations to fine-tune their
1616

1717
For advanced configurations, you can organize override parameters into three logical groups: `api`, `llm`, and `agent`.
1818
### 1. `api`
19-
Values under `api` are merged directly into the model's API request parameters (`headers`). This is useful for configuring provider-specific API options, temperature, or custom headers. For the full list of supported parameters, see the [LiteLLM completion input documentation](https://docs.litellm.ai/docs/completion/input).
19+
Values under `api` are request-level parameters that cecli passes to the provider API. This is useful for configuring provider-specific API options, temperature, or custom headers. For more details, see the [advanced model settings](../config/adv-model-settings.html) page.
2020

2121
**Common parameters**: `temperature`, `top_p`, `max_tokens`, `parallel_tool_calls`, `extra_body` (e.g., `thinking: true` or `reasoning_effort: "high"`).
2222

2323
### 2. `llm`
24-
Values under `llm` are merged into the model's info dictionary (`self.info`). This allows you to override or augment model metadata and capabilities. For a comprehensive list of available model metadata fields, see the [LiteLLM model prices and context window reference](https://github.com/BerriAI/litellm/blob/litellm_internal_staging/model_prices_and_context_window.json).
24+
Values under `llm` are merged into the model's info dictionary (`self.info`). This allows you to override or augment model metadata and capabilities. For a comprehensive list of available model metadata fields, see cecli's bundled metadata in [cecli/resources/model-metadata.json](https://github.com/cecli-dev/cecli/blob/main/cecli/resources/model-metadata.json).
2525

2626
**Common parameters**: `supports_vision`, `supports_function_calling`, token limits, or pricing information.
2727

cecli/website/docs/llms/bedrock.md

Lines changed: 3 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ Amazon Bedrock has added support for a new feature called [cross-region "inferen
1717

1818
If you attempt to use a `Model ID` for a model that exclusively supports the Inference Profile feature, you will receive an error message like the following:
1919

20-
> litellm.BadRequestError: BedrockException - b'{"message":"Invocation of model ID
20+
> BadRequestError: BedrockException - b'{"message":"Invocation of model ID
2121
anthropic.claude-3-7-sonnet-20250219-v1:0 with on-demand throughput isn\xe2\x80\x99t supported. Retry your request with the ID or ARN of an inference profile that contains this model."}'
2222

2323
## Installation and Configuration
@@ -94,22 +94,11 @@ cecli --list-models bedrock/
9494

9595
Make sure you have access to these models in your AWS account before attempting to use them with cecli.
9696

97-
## Install boto3
98-
You may need to install the `boto3` package.
97+
## AWS credentials
9998

100-
```bash
101-
# If you installed with cecli-install or `uv tool`
102-
uv tool run --from cecli-dev pip install boto3
103-
104-
# Or with pipx...
105-
pipx inject cecli-dev boto3
106-
107-
# Or with pip
108-
pip install -U boto3
109-
```
99+
Cecli signs Bedrock requests itself (AWS SigV4) using the standard AWS credentials from your environment (`AWS_ACCESS_KEY_ID`, `AWS_SECRET_ACCESS_KEY` and optionally `AWS_SESSION_TOKEN`), so the `boto3` package is not required.
110100

111101
# More info
112102

113103
For more information on Amazon Bedrock and its models, refer to the [official AWS documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/what-is-bedrock.html).
114104

115-
Also, see the [litellm docs on Bedrock](https://litellm.vercel.app/docs/providers/bedrock).

cecli/website/docs/llms/gemini.md

Lines changed: 0 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -36,15 +36,3 @@ cecli --model gemini-exp
3636
cecli --list-models gemini/
3737
```
3838

39-
You may need to install the `google-generativeai` package.
40-
41-
```bash
42-
# If you installed with cecli-install or `uv tool`
43-
uv tool run --from cecli-dev pip install google-generativeai
44-
45-
# Or with pipx...
46-
pipx inject cecli-dev google-generativeai
47-
48-
# Or with pip
49-
pip install -U google-generativeai
50-
```

cecli/website/docs/llms/github.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,4 +19,4 @@ uv tool install cecli-dev
1919

2020
---
2121

22-
When you specify a github copilot model on start up (e.g. `github_copilot/gpt-5-mini`), [litellm](https://github.com/BerriAI/litellm) will enter a github auth workflow wherein you will connect to your github account with the provided auth code to grant the system access. Further details can be found [here](https://docs.litellm.ai/docs/providers/github_copilot).
22+
When you specify a GitHub Copilot model on start up (e.g. `github_copilot/gpt-5-mini`), cecli will enter a GitHub auth workflow natively, wherein you will connect to your GitHub account with the provided auth code to grant the system access.

cecli/website/docs/llms/other.md

Lines changed: 11 additions & 57 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ nav_order: 800
55

66
# Other LLMs
77

8-
Cecli uses the [litellm](https://docs.litellm.ai/docs/providers) package to connect to hundreds of other models. You can use `cecli --model <model-name>` to use any supported model.
8+
Cecli connects directly to hundreds of models through their providers' APIs, so there is no extra model-routing package to install. You can use `cecli --model <model-name>` to use any supported model.
99

1010
To explore the list of supported models you can run `cecli --list-models <model-name>` with a partial model name. If the supplied name is not an exact match for a known model, cecli will return a list of possible matching models. For example:
1111

@@ -23,70 +23,24 @@ Models which match "turbo":
2323

2424
See the [model warnings](warnings.html) section for information on warnings which will occur when working with models that cecli is not familiar with.
2525

26-
## LiteLLM
26+
## Connecting to other providers
2727

28-
Cecli uses the LiteLLM package to connect to LLM providers. The [LiteLLM provider docs](https://docs.litellm.ai/docs/providers) contain more detail on all the supported providers, their models and any required environment variables.
28+
Cecli connects to each provider through its own request dispatcher (`cecli/helpers/llms/`): when you specify a model, cecli resolves the provider's base URL, API-key environment variable and API family (OpenAI-compatible chat, Anthropic Messages, Responses, Gemini, or Bedrock) and handles authentication and headers itself.
2929

3030
## Other API key variables
3131

32-
Here are the API key environment variables that are supported by litellm. See their docs for more info.
32+
The authoritative list of provider base URLs and API-key environment variables is cecli's own provider configuration (`cecli/resources/providers.json`, which covers 61 providers) plus built-in defaults for the major providers. Each provider page in this section lists the variables you need to set, and `cecli --list-models <partial-name>` shows the model names cecli knows about.
3333

34-
- ALEPH_ALPHA_API_KEY
35-
- ALEPHALPHA_API_KEY
34+
Here are some of the most commonly used API key environment variables:
35+
36+
- OPENAI_API_KEY
3637
- ANTHROPIC_API_KEY
37-
- ANYSCALE_API_KEY
38-
- ARK_API_KEY
39-
- AZURE_AI_API_KEY
40-
- AZURE_API_KEY
41-
- AZURE_OPENAI_API_KEY
42-
- BASETEN_API_KEY
43-
- BYTEZ_API_KEY
44-
- CEREBRAS_API_KEY
45-
- CLARIFAI_API_KEY
46-
- CLOUDFLARE_API_KEY
47-
- CO_API_KEY
48-
- CODESTRAL_API_KEY
49-
- COHERE_API_KEY
50-
- COMPACTIFAI_API_KEY
51-
- DASHSCOPE_API_KEY
52-
- DATABRICKS_API_KEY
53-
- DEEPINFRA_API_KEY
5438
- DEEPSEEK_API_KEY
55-
- FEATHERLESS_AI_API_KEY
56-
- FIREWORKS_AI_API_KEY
57-
- FIREWORKS_API_KEY
58-
- FIREWORKSAI_API_KEY
39+
- OPENROUTER_API_KEY
5940
- GEMINI_API_KEY
60-
- GOOGLE_API_KEY
41+
- META_API_KEY
6142
- GROQ_API_KEY
62-
- HUGGINGFACE_API_KEY
63-
- INFINITY_API_KEY
64-
- MARITALK_API_KEY
43+
- XAI_API_KEY
6544
- MISTRAL_API_KEY
66-
- MOONSHOT_API_KEY
67-
- NEBIUS_API_KEY
68-
- NLP_CLOUD_API_KEY
69-
- NOVITA_API_KEY
70-
- NVIDIA_NIM_API_KEY
7145
- OLLAMA_API_KEY
72-
- OPENAI_API_KEY
73-
- OPENAI_LIKE_API_KEY
74-
- OPENROUTER_API_KEY
75-
- OR_API_KEY
76-
- OVHCLOUD_API_KEY
77-
- PALM_API_KEY
78-
- PERPLEXITYAI_API_KEY
79-
- PREDIBASE_API_KEY
80-
- PROVIDER_API_KEY
81-
- REPLICATE_API_KEY
82-
- SAMBANOVA_API_KEY
83-
- TOGETHERAI_API_KEY
84-
- USER_API_KEY
85-
- VERCEL_AI_GATEWAY_API_KEY
86-
- VOLCENGINE_API_KEY
87-
- VOYAGE_API_KEY
88-
- WANDB_API_KEY
89-
- WATSONX_API_KEY
90-
- WX_API_KEY
91-
- XAI_API_KEY
92-
- XINFERENCE_API_KEY
46+
- AZURE_API_KEY

cecli/website/docs/llms/warnings.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,5 +67,5 @@ If required variables are missing,
6767
you may get errors when you attempt to chat with the model.
6868
You can look in the [cecli's LLM documentation](../llms.html)
6969
or the
70-
[litellm documentation](https://docs.litellm.ai/docs/providers)
70+
provider pages in this section
7171
to see if the required variables are listed there.

cecli/website/docs/troubleshooting/imports.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,4 +35,3 @@ Cecli pins its dependencies and is tested to work with those specific versions.
3535

3636
In particular, be careful with the packages with pinned versions noted at the end of [cecli's requirements.in file](https://github.com/cecli-dev/cecli/blob/main/requirements/requirements.in). These versions are pinned because cecli is known not to work with the latest versions of these libraries.
3737

38-
Also be wary of upgrading `litellm`, as it changes versions frequently and sometimes introduces bugs or backwards incompatible changes.

cecli/website/docs/troubleshooting/support.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -45,9 +45,9 @@ Yes, you can use local LLMs with cecli. Here's a summary of the options:
4545

4646
2. OpenAI-compatible API: cecli can access local models that provide an OpenAI-compatible API.
4747

48-
3. Other local models: cecli uses the LiteLLM package to connect to various LLM providers, which may include options for running models locally.
48+
3. Other local models: cecli connects directly to many LLM providers, including local and OpenAI-compatible endpoints (Ollama, LM Studio, etc.).
4949

50-
However, it's important to note that cecli works best with more capable models. Less capable models may have difficulty properly returning "code edits," which could result in cecli not being able to edit your files and commit changes effectively.
50+
However, it's important to note that cecli works best with more capable models. Less capable models may have difficulty properly returning code edits, which could result in cecli not being able to edit your files and commit changes effectively.
5151

5252
For more detailed information on using local LLMs and connecting to various models, you might want to check out these relevant documentation pages:
5353

cecli/website/docs/troubleshooting/warnings.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -66,8 +66,7 @@ which variables are required for the model.
6666
If required variables are missing,
6767
you may get errors when you attempt to chat with the model.
6868
You can look in the [cecli's LLM documentation](../llms.html)
69-
or the
70-
[litellm documentation](https://docs.litellm.ai/docs/providers)
69+
or the provider-specific pages (e.g. [OpenAI-compatible endpoints](../llms/openai-compat.html))
7170
to see if the required variables are listed there.
7271

7372
## More help

0 commit comments

Comments
 (0)