For us "dinosaurs" who grew up in the terminal, the modern AI revolution has felt a bit... disconnected. We spend our days in a high-performance CLI environment, yet every time we need an LLM’s help, we’re forced to context-switch to a browser, paste code into a chat window, and hope the "copy-paste" cycle doesn't break our flow.I builtqsh (Qwen Shell) to solve this. It’s a local-first, privacy-focused CLI that brings vision and semantic understanding directly into the Unix pipe. No APIs, no data leakage, just a 0.8B-parameter brain running on your local hardware. qsh 1. The "Big Three": Vision, Filter, and Command qsh isn't just a chatbot; it’s an extension of the coreutils philosophy. It treats the LLM as a smart filter. qsh Semantic Vision: The Image PipePowered by Qwen 3.5-0.8B’s unified processor, qsh can analyze visual features alongside text. Instead of manually scrolling through a folder of screenshots to find an error, you can now pipe your images directly into a query: qsh # Find every image with a cat and open it automatically
ls examples/*.jpg | qsh vision "is there a cat?" | xargs open # Find every image with a cat and open it automatically
ls examples/*.jpg | qsh vision "is there a cat?" | xargs open The model evaluates the query for each image, prints the filename only if the answer is "YES," and lets the next pipe handle the result. The Semantic Filter: Grep with Meaning Standard grep is great for finding strings, but it's useless for finding intent. The filter command evaluates standard input against a natural language query: grep intent filter # Filter a messy TODO list by context
cat notes.txt | qsh filter "What is due tomorrow?" # Filter a messy TODO list by context
cat notes.txt | qsh filter "What is due tomorrow?" It acts as a semantic pipe, asking your question for every line of text. The LLM returns a "Yes" or "No," allowing you to sift through logs or notes with human-level logic. Commander Mode: AI-Powered Autocomplete We’ve all been there: you make a mistake in a Git repository and can’t remember the exact syntax to undo the last three commits without losing work. Instead of hitting StackOverflow, you just ask: qsh "Undo my last 3 git commits but keep the changes" qsh "Undo my last 3 git commits but keep the changes" qsh translates your intent into valid, executable Bash. But it doesn't just run it blindly... qsh 2. Safety First: Deterministic Guardrails "But muh safety!" I can already hear the Linux SysAdmins screaming. Giving an AI access to a shell is inherently risky. To solve this, qsh uses a Hybrid Safety Model: qsh Hybrid Safety Model Deterministic Scans: The Rust binary uses a high-performance pattern matcher (defined in safety.rs) to scan the AI's output for dangerous strings like rm -rf /, mkfs, or dd.
Interactive Review: If a command looks dangerous, it’s flagged with bright red text. The user is presented with a two-step confirmation process, offering a chance for further explanation or a hard abort. Deterministic Scans: The Rust binary uses a high-performance pattern matcher (defined in safety.rs) to scan the AI's output for dangerous strings like rm -rf /, mkfs, or dd. Deterministic Scans: safety.rs rm -rf / mkfs dd Interactive Review: If a command looks dangerous, it’s flagged with bright red text. The user is presented with a two-step confirmation process, offering a chance for further explanation or a hard abort. nteractive Review: It’s the best of both worlds: Probabilistic power from the LLM, and Deterministic safety from Rust. 3. The Architecture: Rust AND Python? A common question I get is: "How does a system language like Rust talk to a machine learning language like Python without lag?" I chose a hybrid architecture to play to the strengths of each: "How does a system language like Rust talk to a machine learning language like Python without lag?" Rust: Handles the fast I/O, the SQLite history database, the safety logic, and the CLI interface. Rust Python: Handles the heavy lifting of torch and the transformerslibrary.I would love to use Rust for everything, but support for the latest Qwen 3.5 architectures isn't fully implemented in the Rust Hugging Facecandle library yet— so I submitted a Pull Request to fix that!(https://github.com/huggingface/candle/pull/3396. Until then, we use a high-speed Python bridge.The installation is a simple one-liner that sets up a local virtual environment (qenv) to keep your system clean: Python torch transformers candle so I submitted a Pull Request to fix that! https://github.com/huggingface/candle/pull/3396 qenv curl -sSL https://raw.githubusercontent.com/woodRock/qsh/main/setup.sh | sh curl -sSL https://raw.githubusercontent.com/woodRock/qsh/main/setup.sh | sh 4. The "Local-First" Manifesto Why not just use the OpenAI API or Claude? I’ll give you three reasons: Zero-Data Leakage: Your terminal history and local file paths never leave your machine. Given recent news about AI companies and government contracts, do you really want to send your full file system context to a cloud server?
Offline Utility: qsh works in a basement, on a plane, or in a war zone. You get consistent 100% uptime without worrying about rate limits or server overloads.
The 0.8B Sweet Spot: Qwen 3.5-0.8B is small enough to run on a standard laptop (even without a beefy GPU) but "smart" enough to master Bash syntax. Zero-Data Leakage: Your terminal history and local file paths never leave your machine. Given recent news about AI companies and government contracts, do you really want to send your full file system context to a cloud server? Zero-Data Leakage: Offline Utility: qsh works in a basement, on a plane, or in a war zone. You get consistent 100% uptime without worrying about rate limits or server overloads. Offline Utility: qsh The 0.8B Sweet Spot: Qwen 3.5-0.8B is small enough to run on a standard laptop (even without a beefy GPU) but "smart" enough to master Bash syntax. The 0.8B Sweet Spot: 5. Built to Last: Stability & Memory For a tool to be truly "useful," it needs to be reliable. SQLite Memory:qsh doesn't see commands in isolation. It stores your session history in a local SQLite database. This allows for context-aware follow-ups like: qsh "What was that file I just listed?"
Robust Testing: Stability isn't an afterthought. We've implemented a comprehensive integration test suite and a GitHub Actions CI pipeline to ensure that the semantic logic and safety guardrails remain intact as the tool grows. SQLite Memory:qsh doesn't see commands in isolation. It stores your session history in a local SQLite database. This allows for context-aware follow-ups like: qsh "What was that file I just listed?" SQLite Memory: qsh qsh "What was that file I just listed?" Robust Testing: Stability isn't an afterthought. We've implemented a comprehensive integration test suite and a GitHub Actions CI pipeline to ensure that the semantic logic and safety guardrails remain intact as the tool grows. Robust Testing: 6. What’s Next? The goal is to eventually move the inference entirely into Rust once the candleecosystem catches up, removing the Python dependency altogether.Until then,qshis here to give your Unix pipes the brain they’ve been waiting for.Check out the project on GitHub: https://github.com/woodrock/qsh candle qsh Check out the project on GitHub: https://github.com/woodrock/qsh https://github.com/woodrock/qsh

This post provides insights into new product. 

This story contains new, firsthand information uncovered by the writer.

OpenAI

The Story of a Brain: AI Anxiety and the Illusion of the Mind

Beyond Grep: Giving the Unix Pipe a Brain With Qsh

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

ACNH Island Transfer Tool: Communication Error

The Noonification: How Often Do NFTs Pass The Howey Test? (1/13/2023)

Darwin's Hybrid Intelligence to Align AI & Human Goals for Startups & VCs

The Noonification: White Man (11/26/2022)

The Noonification: The Metaverse is a Sh*tshow (11/2/2022)

100 Days of AI Day 1: From Newsletter to Podcast, Leveraging AI for Audio Transformation

ACNH Island Transfer Tool: Communication Error

The Noonification: How Often Do NFTs Pass The Howey Test? (1/13/2023)

Darwin's Hybrid Intelligence to Align AI & Human Goals for Startups & VCs

The Noonification: White Man (11/26/2022)

The Noonification: The Metaverse is a Sh*tshow (11/2/2022)

100 Days of AI Day 1: From Newsletter to Podcast, Leveraging AI for Audio Transformation

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps