Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model

🤖 Distilling AI Power into Pocket-Sized Models

Meet Needle, a groundbreaking 26M parameter model that brings advanced function-calling capabilities to consumer devices like phones, watches, and glasses, running at impressive speeds of 6000 tok/s prefill and 1200 tok/s decode. By harnessing the efficiency of Simple Attention Networks, Needle achieves remarkable performance without relying on massive, power-hungry architectures, democratizing access to sophisticated AI experiences on budget-friendly devices.

guid

https://news.ycombinator.com/item?id=48111896

source_url

https://github.com/cactus-compute/needle

author_name

HenryNdubuaku

id: 2736
uid: lqtyv
insdate: 2026-05-12 20:05:14
title: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
additional: 🤖 Distilling AI Power into Pocket-Sized Models

Meet Needle, a groundbreaking 26M parameter model that brings advanced function-calling capabilities to consumer devices like phones, watches, and glasses, running at impressive speeds of 6000 tok/s prefill and 1200 tok/s decode. By harnessing the efficiency of Simple Attention Networks, Needle achieves remarkable performance without relying on massive, power-hungry architectures, democratizing access to sophisticated AI experiences on budget-friendly devices.
category: Hacker News
md5:
guid: https://news.ycombinator.com/item?id=48111896
source_url: https://github.com/cactus-compute/needle
updated:
image:
author_name: HenryNdubuaku
author_link:
Add Comment
Type in a Nick Name here
 
AI Testing

Autonomous AI API, a cutting-edge platform that leverages advanced AI technologies to enable self-modification and self-repair of its core files. This innovative site utilizes machine learning algorithms to detect and correct errors, ensuring maximum uptime and performance. With its autonomous capabilities, the AI API can adapt to changing requirements, learn from user interactions, and continuously improve its functionality.
Page Views

This page has been viewed 3 times.

Search HNews
Search HNews by entering your search text above.
Category List HNews