TrackOSC
Camera tracking over OSC
Only for iPhone
Free · Designed for iPhone. Not verified for macOS.
iPhone
Turn your iPhone into a wireless motion-tracking camera: 2D and 3D body, hand, face, outline and rectangle tracking streamed live over OSC to TouchDesigner, Max and more.
TrackOSC turns your iPhone into a wireless motion-tracking camera. Point it at a person and it streams live tracking data – body poses in 2D and 3D, hand poses, face landmarks, recognised text, animals, people, barcodes, outlines, the horizon and rectangles – over your local network as OSC (Open Sound Control) messages, ready for TouchDesigner, Max/MSP, Processing, openFrameworks, Pure Data, SuperCollider, Unity, or anything else that speaks OSC.
All processing happens on-device with Apple's Vision framework. No video ever leaves your phone – only numbers.
WHAT IT TRACKS
• 2D Body: a 17-joint skeleton in pixels
• 3D Body: a 17-joint skeleton in metres – real depth from a single camera, with each joint's pixel position alongside
• Hand: 21 joints per hand, up to two hands
• Face: the face box, head rotation and jawline contour, and Face Landmarks: the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw
• Text: recognised text with its bounding box
• Animal: cat and dog boxes, and Animal Pose: full 25-joint cat and dog skeletons
• Human: whole-body boxes that keep counting people at distances where pose estimation gives up
• Barcode: QR codes and 1D/2D barcodes with position, corners, symbology and payload
• Contours: every edge outline in the frame as closed polylines
• Horizon: the horizon's angle and a line across the frame
• Rectangles: screens, paper, doors – a box plus four corners
FEATURES
• Live tracking overlays on the camera view, colour-coded per detector
• One chip per detector – run just what you need for the best frame rate; 3D Body runs in its own lane so it never slows the others
• Front or back camera, with a natural selfie mirror (wire data is never mirrored)
• Portrait and landscape, with an orientation lock for phones mounted on tripods and rigs
• Automatic discovery of receivers on your network via Bonjour – or type any IP and port
• Hide-video mode: tracking overlay only, on black – for stage and installation use
• Free, notarised macOS companions – a Receiver with 2D and 3D views, a Recorder that records and replays the stream, a Speaker that reads it aloud, and a Router that turns it into MIDI, Shortcuts, key presses and HTTP – plus open-source receiver examples for Processing, Python, p5.js, TouchDesigner, Max/MSP, Pure Data, openFrameworks and SuperCollider, all from the project page
COMPATIBILITY
TrackOSC speaks exactly the same OSC wire format as VisionOSC and PoseOSC, so existing receivers and patches work unchanged. The newer detectors arrive as additional messages that older receivers simply ignore. Coordinates are in pixels, origin top-left, with the frame dimensions in every message.
PRIVACY
No accounts, no analytics, no ads. Camera frames are analysed on the device and discarded; tracking data is sent only to the destination you choose.
TrackOSC is open source: https://github.com/JGL/TrackOSC
Three new things to track, a clearer face, and a new chip for landmarks.
• Face Landmarks: a chip of its own next to Face. Face sends the box with head angles and the jawline; Face Landmarks sends the full 76-point constellation – eyes, pupils, brows, nose, lips, jaw – now drawn feature by feature on the overlay.
• Contours: every edge outline in the frame, simplified and streamed as closed polylines.
• Horizon: the angle of the horizon and a line across the frame.
• Rectangles: screens, sheets of paper, doors – box plus four corners in the rectangle's own orientation.
• Twelve detector chips, in a row that scrolls sideways.
The new data goes out as three additional OSC messages (/contours/arr, /horizon, /rectangles/arr); every earlier message is unchanged, so existing receivers keep working. The free macOS apps – Receiver, Recorder, Speaker and Router – gain a true full-screen mode with a chosen background colour, and a Senders setting so a recording played back is never mixed with a live phone.
Everything is still processed on the device; no video ever leaves your phone.
The developer, Joel Lewis, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Collected
The developer does not collect any data from this app.
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Seller
- Joel Lewis
- Size
- 4.4 MB
- Category
- Developer Tools
- Compatibility
Requires iOS 18.0 or later.
- iPhone
Requires iOS 18.0 or later. - Mac
Requires macOS 15.0 or later and a Mac with Apple M1 chip or later. - Apple Vision
Requires visionOS 2.0 or later.
- iPhone
- Languages
- English
- Age Rating
4+
- 4+
- Copyright
- © 2026 Joel Gethin Lewis
