Composable building blocks to build LLM Apps

Agentic components of the Llama Stack APIs

A full-stack Webui implementation of Large Language model, such as ChatGPT or LLaMA.

Python SDK for Llama Stack

Full stack advanced chatbot over LlamaIndex.TS documentation with preview feature using Multi-documents-agents, bootstrapped with create-llama

Built using Open Source Stack (Llama 3.2 Model, BGE Embeddings, and Qdrant running locally within a Docker Container)

Typescript library for Llama Stack

This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding model, Qdrant as a self hosted Vector DB, and Langchain & Llama CPP as an orchestration frameworks.

Prompt Manager for ComfyUI, with integration with llama.cpp for prompt generation. Allowing users to generate and save prompts, as well as extract prompts from existing images and video.. The Advance node also allows saving Lora Stacks allong with prompts. Giving the user the option of saving the complete Recipe.

Kotlin SDK for Llama Stack

llama.cpp optimizations for IBM POWER8: vec_perm non-bijunctive collapse, PSE hardware entropy, DCBT prefetch. Sovereign inference. Part of the Proof of Physical AI stack.

llama-stack-client-swift brings the inference and agents APIs of Llama Stack to iOS.

Collection of demos for building Llama Stack based apps on OpenShift

a full stack fastapi application with llama index integrated

ASP.NET Core Web, WebApi & WPF implementations for LLama.cpp & LLamaSharp

Knowledge chatbot using Agentic Retrieval Augmented Generation (RAG) techniques. Full-stack proof of concept built on langchain, llama-index, django, pgvector, with multiple advanced RAG techniques used.

An open source UI for Meta LLama Stack Apps / Agents

This project implements a RAG (Retrieval-Augmented Generation) system using an open-source stack. It utilizes BioMistral 7B as the main model along with other technologies such as PubMedBert for embedding, Qdrant for a self-hosted Vector DB, and Langchain & Llama CPP for orchestration frameworks.

One stop shop - Local-first RAG stack with intelligent polyglot-code/docs, remote code execution, local llama enrichment, progressive disclosure tools, mcp server, sandboxed security.

This is a LlamaIndex project bootstrapped with create-llama to act as a full stack UI to accompany Retrieval-Augmented Generation (RAG) Bootstrap Application.

No description available

An external provider for Llama Stack allowing for the use of RamaLama for inference.

This is a RAG implementation using Open Source stack. BioMistral 7B has been used to build this app along with PubMedBert as an embedding model, Qdrant as a self hosted Vector DB, and Langchain & Llama CPP as an orchestration frameworks.

RAG Based LLM Chatbot Built using Open Source Stack (Llama 3.2 Model, BGE Embeddings, and Qdrant running locally within a Docker Container)

Ops files for https//github.com/meta-llama/llama-stack

Llama Stack Examples

LLM-based Chatbot for PetCare. The app is built on open source stack and useful for Vet Doctors, Pet Lovers, etc. Supercharge your PetCare conversations with our lightning-fast AI chatbot powered by Llama 2.

This repository contains all the helm charts to deploy LLM service, Llama Stack server, configuring pipeline server, minio, pgvector

Draw book mind maps to see the relationship between characters easily :)

No description available