Scrawl: show an agent the problem

Scrawl

2 min read Original article ↗

Press ⌥⇧S, talk, click, and draw. Paste the result into your agent.

Download for Mac

Version 0.3.14 · Apple silicon · macOS 15 or later

  • MacApple silicon, macOS 15+Download

    $ brew install --cask kitlangton/tap/scrawl

  • Windowsx64, preview, unsignedDownload

  • LinuxSoon

iPhone

Plug it into your Mac

Your iPhone’s screen appears in a window on the Mac, and you talk and draw over it as it records.

Record inside your own app

Add ScrawlKit to your iOS app to record on the phone itself, with every tap and swipe drawn on the frames.

How it works

Frames only when something happens

Scrawl takes a frame when you draw, click, say “look” or “now”, or the screen changes.

Each frame keeps its words

Your speech is transcribed on your computer, and each sentence goes with the frame it was about.

Cropped to where you worked

Record the whole screen, and each frame is cut down to the window you drew or clicked in.

A closer look when it’s needed

The agent can ask for a dense grid of frames around any moment, by time or by a phrase you said.

Controls

  • ⌥⇧SStart or finish
  • ⇧Hold and drag to draw
  • ⇧clickDrop a numbered pin
  • ⌘ZUndo
  • escCancel
  • ⌥⇧VPaste the latest capture
  • MFlag a moment on iPhone

Install

Homebrew

$ brew install --cask kitlangton/tap/scrawl

Terminal

$ curl -LO https://scrawl.kitlangton.com/releases/Scrawl-latest-arm64.zip

$ unzip Scrawl-latest-arm64.zip -d ~/Applications

$ open ~/Applications/Scrawl.app

For agents

$ bunx skills add kitlangton/scrawl

With the skill, an agent that gets a Scrawl paste reads the contact sheet and transcript, opens the keyframes the narration points at, and uses the scrawl command to look closer.