starred/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-03-02 22:57:05 -05:00
Code Issues 294 Projects Packages Wiki Activity

[FEAT]: Built in llama-cpp integration with a model download interface #3211

New issue
Open
opened 2026-02-28 06:33:34 -05:00 by deekerman · 0 comments
deekerman commented 2026-02-28 06:33:34 -05:00
Owner
Copy link

Originally created by @pratik-narain on GitHub (Feb 25, 2026).

What would you like to see?

Since vulkan support in ollama is still experimental, and LM Studio is just another piece of external software to run, a llama-cpp backend built into anythingllm with configuration options and download from huggingface would make this the true one-stop local LLM solution.

Originally created by @pratik-narain on GitHub (Feb 25, 2026). ### What would you like to see? Since vulkan support in ollama is still experimental, and LM Studio is just another piece of external software to run, a llama-cpp backend built into anythingllm with configuration options and download from huggingface would make this the true one-stop local LLM solution.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
5066-new-prompt-input-ui-action-items
5112-bug-openrouter-failed-message-bug
5086-feat-refactor-settings-pages-to-use-a-shared-layout-with-react-router-instead-of-duplicating-settingssidebar-in-every-page
render
pg
3506-feat-parameters-for-openrouter-models
5023-normalize-translations
5023-feat-implement-new-citations-ui
5060-bug-agent-interactions-agent-are-not-persisted-to-thread-history-via-api
4992-feat-preserve-scroll-position
4983-feat-new-chat-history-implementation
4973-bug-markdown-numbered-list-display-in-reasoning-pane
desktop
4938-bug-pending-chat-rerendering-ui-bug
quickstart-env
1.10.0-repub
node-llama-cpp-in-container-cuda
node-llama-cpp-in-container
ollama-in-container
4817-feat-set-cooldown-per-mcp-server
foundry-local-improvements
4845-keyboard-shortcuts-to-navigate-in-chat
4844-feat-reorder-threads-by-latest-interaction
standardize-username-constraints-normalize-translations
4792-feat-refactor-workspacepfp-image
1382-embed-ip-improvements
1382-bug-embed-api-improvements
refactor-eslint-frontend
new-landing-ui-poc
1.9.1-rerelease
4687-feat-refactor-vector-db-providers
4615-feat-disable-apidocs-with-environment-variable
4559-feat-agent-web-search-enable-ordering-of-results
4599-bug-ollama-race-condition-bug
4572-bug-lmstudio-provided-llm-stopped-working-with-anything-llm-after-upgrading-to-190
4391-feat-integrate-docker-model-runner-as-a-local-inferencing-provide
4508-agent-youtube-transcript-analysis
4497-feat-workspace-names
frontend-eslint
ollama-lmstudio-auto-context-window
4431-validate-vector-database-connectioN
2019-slash-command-keyboard-selection
microsoft-foundry-provider
4431-validate-vector-database-connection
4325-sys-prompt-var-improvements
3209-feat-apiv1workspacestream-chat-sources-citations
4210-bug-voice-to-text-overwrite
4136-feat-jan-as-a-backend-server-option
4172-feat-openai-o3-support
1.8.3-rerelease
web-push-notifications-service
tasks
3955-feat-jinaai-embedder-provider-support
3921-feat-agent-skills-uiux-improvements
3901-bug-validfunccall-checks-optional-arguments
keyboard-dev
1787-custom-roles-and-permissions
add-jira-slack-data-connector
office-extension-wip
lightmode-dropdown-color-update
3586-bug-agent-flow-function-description-provided-by-user-is-not-seen-in-the-llm-query
3463-bug-agent-continues-to-run-if-request-failed-even-after-exit
3439-feat-call-variables-within-the-flow-api-block-url-field
3282-manager-view-models-workspace
3280-token-counting-server-side-truncation-improvements
3147-bug-embedded-chat-widget---not-considering-query-mode-option-always-working-in-chat-mode
2995-feat-disable-temperature-setting-for-deepseek-r1-deepseek-reasoner-model
2827-feat-perplexity-citations
2866-feat-finally-a-gemini-models-endpoint
2647-feat-hpp-header-for-a-c++-code-file-mime-addition
lancedb-revert
1656-feat-implement-tooltip-ui-designs
2011-feat-bump-perplexity-models
1873-feat-auto-add-and-watch-folder-for-document-uploads
1297-feat-gemini-agent-support
1759-bug-ui-bug-fixes
1686-feat-implement-winston-for-logging
1536-bug-toggling-on-users-can-delete-workspaces-does-not-take-effect
agent-ui-mobile-styles
1522-feat-chromadb-support
1595-bug-unable-to-get-live-web-search-and-browsing-agent-working-using-google-custom-search-engine-error-getaddrinfo-enotfound-http-errno-3008
1582-bug-lm-studio-does-not-allow-for-different-model-selection
1312-bug-usernames-should-not-be-case-sensitive-when-logging-in
1029-feat-hf-serverless-inference-api
1086-feat-implement-normalized-input-fields
knowledge-graph-support
644-bug-uploaded-file-name-does-not-match-the-displayed-file-name-after-the-upload
v1.11.1
v1.11.0
v1.10.0
v1.9.1
v1.9.0
v1.8.5
v1.8.4
v1.8.3
v1.8.2
v1.8.1
v1.8.0
v1.7.8
v1.7.6
v1.7.5
v1.7.4
v1.4.0
v1.3.0
v1.2.4
v1.2.3
v1.2.2
v1.2.1
v1.2.0
v1.1.1
v1.1.0
v1.0.0
Labels
Clear labels   
Desktop

   
Docker

   
Integration Request

   
Integration Request

   
OS: Linux

   
OS: Mobile

   
OS: Windows

   
UI/UX

   
blocked

   
bug

   
bug

   
core-team-only

   
documentation

   
duplicate

   
embed-widget

   
enhancement

   
feature request

   
github_actions

   
good first issue

   
investigating

   
needs info / can't replicate

   
possible bug

   
question

   
stage: specifications

   
wontfix
No labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
question
stage: specifications
wontfix
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/anything-llm#3211
No description provided.