Distribute and run LLMs with a single file.

User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!

A SQLite extension for generating text embeddings from remote APIs (OpenAI, Nomic, Ollama, llamafile...)

No description available

Distribute and run llamafile/LLMs with a single docker image.

A repo to help you get your Llamafile up and running quickly

AI Toolkit for Node.js (LLM, Image Generation, Embeddings, Vector Search)

Local LLMs in One Line Of Code (thanks to llamafile)

Simple llamafile setup with docker

Run CrewAI agent workflows on local LLM models with Llamafile and Ollama

Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge bases in one click, without complex configuration.

Create an IRC chat bot powered by AI, using llamafile, in minutes.

Chat with LLMs locally utilizing llamafile as the underlying model executor.

Access llamafile localhost models via LLM

An Offline and Secure Retrieval-Augmented Generation (RAG) system designed for efficient processing of diverse content types with minimal computational overhead. This system use only open source tools such as LangChain, FAISS , Docling, Llamafile, Mistral Nemo, Streamlit, Hugging Face Transformers, and so on ...

No description available

A simple github actions script to build a llamafile and uploads to huggingface

No description available

Scalable AI Inference Server for CPU and GPU with Node.js | Utilizes llama.cpp and parts of llamafile C/C++ core under the hood.

This GUI aims to simplify the process of converting GGUF files to llamafile format by providing an intuitive and convenient way for users to interact with the underlying conversion script.

helpful scripts for llamafiles

A llamafile application starter

Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda

This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.

A quantized LLM and API webserver in one single executable file

Scripts to create llamafiles.

No description available

No description available

API Proxy for AI models, rate limiting, management and more!

No description available