DesktopAIProductivityMultimodal

RegionSelect – Drag to Ask AI

Drag a box on screen and immediately ask AI, with no tab switching

Problem
Users describe the usual workflow as screenshot, switch to a chat tab, upload, then switch back—slow and disruptive; meanwhile basic assistants like Siri handle simple cross-app requests poorly, so people want a more immediate way to ask about what is on screen.
Solution
A menu-bar desktop tool: press a hotkey, drag a box over any screen region, and it sends the screenshot to a multimodal model, returning the answer in a floating panel with copy, follow-up, and history, without leaving the current workflow.
Users
Developers, designers, researchers, and knowledge workers who need to quickly understand charts, errors, or UI on screen.
MVP
Global hotkey for region selection; auto-screenshot and multimodal API call; floating answer panel with follow-ups; copy/save results; model switching and usage display.
Revenue
Free tier plus subscription for higher volume, local models, and synced history; optional per-call API billing.
Why now
Multimodal models are now fast and cheap enough, and native screenshot with Tauri/Rust makes a solo-built utility viable, while system-level assistants still struggle with cross-app screenshot Q&A.

Source discussions · 2

  1. Hacker NewsShow HN: Squint – Drag a box on your screen and ask AI about it3↑ 0
  2. Hacker NewsAsk HN: What am I missing with Siri AI?1↑ 1
← Back to list