Add photoassets/projects/bracketbutler.jpg
Add photoassets/projects/bracketbutler-2.jpg
Add photoassets/projects/bracketbutler-3.jpg
Add photoassets/projects/bracketbutler-4.jpg
Add photoassets/projects/bracketbutler-5.jpg
A team hackathon build on top of the BracketBot platform: an autonomous waiter that docks itself, lifts a tray with both arms, delivers it, and takes voice commands — built end-to-end in 24 hours with Oscar Liang, Oscar Low, and Shiv Kanade.
- Extended the pre-existing BracketBot base with a custom docking station and tray, enabling fully autonomous pickup and delivery with zero teleoperation.
- Built ArUco-tag visual navigation: a calibrated fisheye camera solves marker pose via OpenCV PnP, driving a closed-loop visual-servo controller to the tray, dock, and user.
- Solved smooth, spill-free two-arm lifting using the bbos pub/sub framework for coordinated dual-arm control with preset pose interpolation ("ramping"), backed by a retry-with-verification loop that cross-checks real motor encoder positions against target commands until convergence.
- Integrated on-device speech recognition (faster-whisper over WebSockets) so the robot responds to spoken food requests and drop-off confirmations.