Overview

Promptly is an offline-first AI terminal assistant built to turn natural language into useful terminal actions without depending on a remote backend. It focuses on fast local execution, predictable behavior, and a developer experience that feels immediate inside the terminal.

Highlights

• Built in Rust with sub-100ms query latency through lazy model loading.
• Used HNSW indexing on Qdrant to keep retrieval fast and lightweight for local usage.
• Reached 1,000+ users, was featured on Hacker News with 200+ upvotes, and saw adoption from developers globally.

Tech Stack

• Rust
• Qdrant
• Ollama
• Local LLMs