3D-printed open-source humanoid robot platform for sim-to-real and RL

A python package of Zeroth-Order Optimization (ZOOpt)

Kaldi-based Korean ASR (한국어 음성인식) open-source project

ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]

This is the official repo for the paper "Zeroth-Order Optimization Meets Human Feedback: Provable Learning via Ranking Oracles", Tang et al. https://arxiv.org/abs/2303.03751

ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks

Recursive and arbitrary code execution at kernel-level without a system thread creation

[ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

A python package of Zeroth-Order Optimization (ZOOpt)

[ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Diffenderfer, Jiancheng Liu, Konstantinos Parasyris, Yihua Zhang, Zheng Zhang, Bhavya Kailkhura, Sijia Liu

Codes for reproducing the black-box adversarial attacks in “ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Models,” ACM CCS Workshop on AI-Security, 2017

Codes for reproducing query-efficient black-box attacks in “AutoZOOM: Autoencoder-based Zeroth Order Optimization Method for Attacking Black-box Neural Networks” ​​​​, published at AAAI 2019

This repository contains the PyTorch implementation of Zeroth Order Optimization Based Adversarial Black Box Attack (https://arxiv.org/abs/1708.03999)

Core library of the Zeroth Stack

Code for paper 'ZO-AdaMM: Zeroth-Order Adaptive MomentumMethod for Black-Box Optimization'

Implementation of the paper "MAZE: Data-Free Model Stealing Attack Using Zeroth-Order Gradient Estimation".

[ICLR 2025] Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization

Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer

[!!DEPRECATED!!] See https://github.com/zerothstack/zeroth for renamed project

Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)

Fine-tuning Quantized Neural Networks with Zeroth-order Optimization

[ICLR'20] Learning to Learn by Zeroth-Order Oracle

This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-order Optimization.

Zeroth-order Min-max Optimization

[EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning'

Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"

Zeroth-Order Regularized Optimization (ZORO): Approximately Sparse Gradients and Adaptive Sampling

Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning

Codes from the paper "A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization"

Forward-Only Zeroth-Order Prompt Optimization for Test-Time Adaptation (CVPR 2026)