onehumanbeing/esp32-iphone-agent

Loading README…

Part	Notes
ESP32-S3 board	Tested with a Seeed Studio XIAO ESP32S3 (plain version, 8 MB PSRAM; not Sense, not Plus). About $7. Any ESP32-S3 with native USB on its USB-C port and PSRAM should work.
iPhone	iOS 18 or later, with cellular data (the Wi-Fi is taken by the board's hotspot). USB-C models plug in directly; Lightning models need a Lightning to USB Camera Adapter. The phone powers the board.
Vision model	Any OpenAI-compatible chat API that accepts images: a cloud API or your own server.
Mac with Xcode	Only to flash the board and build the app once. Not needed at run time.

Project	Approach	Difference from this project
VersaiOS	UxPlay mirroring + ESP32-S3 Bluetooth mouse + vision model	Needs a computer; one tap per instruction
ja1chen/actell	Agent app on the iPhone via Apple's CoreDevice debug channel	Needs Developer Mode and a Developer Disk Image
AidenAI-IO/aiden-firmware	HDMI capture + USB keyboard/mouse + multimodal model	Capture hardware; mainly Android
yoyicue/glassbox	PicoKVM HDMI capture + USB HID	macOS controller and PicoKVM
boboabw/phone-agent	ESP32-S3 Bluetooth HID + AssistiveTouch, agent as an iPhone app	Closest to this version; this one also brings the eyes (AirPlay on the board)
VKCOM/devicehub	ESP32 Bluetooth mouse for iOS device farms	Device-farm tooling, no AI agent

ESP32 iPhone Agent