01
Surveyed before you arrive
An agent walks the building's scan once. It names every room, checks everything a cane would miss, and writes landmarks you can feel or hear.
From the street to the room.
Isaac shows the way.
See how a walk works
The film
A walk through a building its traveller has never seen.
How it works
From the door to the room. Without sight, on your own.
GPS stops at the street and a cane only finds what's right ahead. Isaac covers the rest.
02
Door to door
Isaac lines the scan up with the street and picks the entrance, checked in aerial photos of the facade, crosswalks included.
03
Turn by turn, by touch
The phone on your back counts steps and reads the compass. The belt taps the side to turn, and the voice says only a distance and a direction.
04
Someone always knows
Your caretaker follows on a live map or by text, and hears right away if you ask for help.
Inside and out
Built on the building's own data.
66scan positions
2floors, joined at the real stairs and elevator
18named places to ask for
0.7 mscan lined up with the street
The Julis Romo Rabinowitz Building, Princeton.
The inside
Walls and rooms become the walking map. The point cloud finds doorways and head-height hazards; the panoramas confirm them.
The outside
Facade photos show which door is the entrance and whether it has steps; crosswalks and curbs shape the walk up to it.
The record
Year built, renovations and ADA status, so the survey is stricter in an older building, and tenants become places you can ask for.
Every hazard, checked
A cane finds the floor. Isaac checks everything above it.
The point cloud flags anything at waist-to-head height with nothing under it, and every wall the scan barely saw. Code walks every lead, so none is skipped, and a Gemini agent judges each one from a view rendered right at it.
1
Lead
an overhang or a glass suspect, from the point cloud
2
A view
rendered from the nearest panorama, aimed at it
3
A verdict
the agent names the object: hazard, not, or can't tell
4
The cane rule
tables and railings never count: a cane finds their legs
5
Evidence
the view is kept, and the router steers around it
55leads judged at JRR
32confirmed hazards
23rejected, with the reason
0skipped
Confirmed: 26 glass walls and doors, 2 open stair undersides, 4 things on the wall at head height.
Agents
Agents in the back. Never in the way.
Before the visit
A LangChain Deep Agent surveys the building with five specialists, checks its own work against the router, and keeps what it learned for the next building.
place-indexerhazard-scoutlandmark-writersite-surveyorbuilding-cartographer
When something changes
A locked door or a blocked hall goes to a second agent. It proposes a way around in about four seconds and waits for a yes. Stop or turn back, and Isaac asks whether something is in the way.
The route itself is plain A*, in milliseconds. No model guesses during the walk.
Talk to Isaac
Call it. Text it. No screen needed.
A phone call
Call Isaac's number and ask for a room. The trip goes to the phone on your back, and the walk starts where you stand.
Your call→Photon number→SIP→ElevenLabs voice→Isaac
What it says
A distance and a direction. Hazards by height and side. Never what something looks like: the traveller can't use it.
Leg12 meters, then left.
TurnLeft now.
HazardHead-height obstacle on your left. Keep right.
FloorElevator up to Floor 2.
Caretakers
For the people who look out for them.
Isaac Care
A live floor-plan map, a timeline of the trip and an alert the moment help is asked for. Send a trip and the traveller's phone starts it.
Or just text
Over iMessage, through Photon. Ask where they are, and hear when they arrive. The traveller can text too.
where is he?
Arkan is in the Atrium on the ground floor, about 18 meters to go.
Architecture
Everything it runs on.
Three sponsors' data, agents ahead of the walk, a deterministic core during it, and every way a person can reach it.
Swipe the diagram sideways to see all of it.
Building data
Matterport Model APIMatterPak point clouds360° panoramasShowcase SDKVexcel facades, elevation, crosswalksCoStar data kitOpenStreetMapUSGS 3DEP
Agents and models
LangChain Deep AgentsLangGraph StudioGemini 3.5 Flash Litestructured verdictshuman-in-the-loop reroutesClaude and OpenRouter fallbacks
Voice and messaging
Photon iMessage APIPhoton phone number + SIPElevenLabs agentsApple Speech + AVSpeechWeb Speech API
The core
PythonFastAPIUvicornNumPyPillowserver-sent eventsDockerCloudflare Tunnel400+ pytest tests
On the body
Raspberry PiPCA9685 servo boardSG90 servospigpioBLE packets under 20 bytesESP32 first prototype
Apps and web
SwiftUI: Isaac + Isaac CareCore MotionCore LocationXcodeGenExpo + React Nativethree.js venue in 3D
Under it: a walk graph built from scan positions, doorways found as posts in the point cloud, A* with blind and wheelchair profiles, step-and-compass dead reckoning, stall detection, and the scan lined up with the street to 0.7 m. Open the full system design →
Try it
Not in the App Store yet. Four ways in anyway.
Call Isaac
Ask for a room by voice. It plans the walk and talks you through it.
Number coming soonText Isaac
Over iMessage: where am I, take me somewhere, or follow someone as their caretaker. The line takes texts from numbers we've added.
Number coming soonIn your browser
Hold to talk and walk a route on the venue's real map. Works best in Chrome.
Open the voice demoFor caretakers
Follow a trip live on the floor plan, and get the alert when help is asked for.
Open the caretaker viewThe iPhone apps
Isaac and Isaac Care are native SwiftUI apps. Today they're installed from source with Xcode; TestFlight is next.
Built on
MatterportVexcelCoStarLangChainGeminiPhotonElevenLabs