[FEAT]: LLM API (llmapi.ai) integration #3204

New issue

Open

opened 2026-02-28 06:33:26 -05:00 by deekerman · 0 comments

deekerman commented

2026-02-28 06:33:26 -05:00

Owner

Originally created by @MarkosBK on GitHub (Feb 24, 2026).

What would you like to see?

Problem

AnythingLLM doesn't support LLM API — an AI model aggregator with an OpenAI-compatible API.

Solution

Add LLM API as a supported LLM provider.

Details:

Base URL: https://internal.llmapi.ai/v1
OpenAI-compatible API (drop-in replacement, no special SDK needed)
Dynamic model loading from /v1/models (no API key required to fetch models)
Supports chat, RAG, and agents

Originally created by @MarkosBK on GitHub (Feb 24, 2026). ### What would you like to see? ## Problem AnythingLLM doesn't support [LLM API](https://llmapi.ai) — an AI model aggregator with an OpenAI-compatible API. ## Solution Add LLM API as a supported LLM provider. **Details:** - Base URL: `https://internal.llmapi.ai/v1` - OpenAI-compatible API (drop-in replacement, no special SDK needed) - Dynamic model loading from `/v1/models` (no API key required to fetch models) - Supports chat, RAG, and agents

deekerman added the

enhancement

feature request

labels

2026-02-28 06:33:26 -05:00

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

starred/anything-llm#3204

No description provided.

Rows
Columns