The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

A Framework of Small-scale Large Multimodal Models

A tiny x86 retro computer

A tiny x86 retro computer

Train your own small bitnet model

A CLI to manage install and configure llama inference implemenation in multiple languages

A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux

Training and Fine-tuning an llm in Python and PyTorch.

A simple Python script for running LLMs on Intel's Neural Processing Units (NPUs)

Run 🦙 @ollama and 🐬 TinyDolphin, 🦙 TinyLlama and other small LLMs on a Raspberry Pi 5 with @Docker #Compose

tinyllama-finqa-app

♾️🦙 Let's DIY infinite TinyLlamas in your room!

An accessible home server platform for AI software

A side project that follows all the acceleration tricks in tinyllama, with the minimal modification to the huggingface transformers code.

A C++ implementation of tinyllama inference on CPU.

https://github.com/jzhang38/TinyLlama using only PyTorch

ROM / BIOS for the TinyLlama retro computer

LinkedIn LLM Post Generator – Generate high-quality, professional LinkedIn posts completely offline using a fine-tuned open-source model (TinyLLaMA-1.1B-Chat). Built with PEFT + LoRA on Apple M3, this project requires no cloud APIs and supports themes like internships, promotions, certifications, and project completions.

This application allows users to upload PDF files, process them, and ask questions about the content using a locally hosted language model. The system uses Retrieval-Augmented Generation (RAG) to provide accurate answers based on the uploaded PDFs.

TinyLLama trained with medical dataset and saved as GGUF file

This repository contains code and resources for fine-tuning a Tiny Llama base model for code generation tasks. The project aims to leverage advanced machine learning techniques to improve the performance of code generation models.

A real-time offline voice-to-voice AI assistant built for Raspberry Pi

TinyLlama on Cortex-M55 using CMSIS-DSP and Helium vector instructions

OpenVINO LLM Node.js C++ addon

ROM / BIOS for the TinyLlama v2 retro computer

A side project that pretrains a tinyllama on Chinese corpora, with the minimal modification to the huggingface transformers code.

A basic script for running an ensemble of TinyLlamas on MLX to annotate an Argilla Dataset

docker extension that installs and configures Ollama, llama.cpp, LlamaEdge, Open WebUI, a tiny open source LLM (tinyllama) on top of Rancher Desktop for local GenAI exploration & development.