Project Progress
Server Hosted LLMs
We've transitioned to using Large Language Models (LLMs) hosted on external servers, leveraging free-tier access from two providers: Groq and Gemini. Groq enables ultra-fast response times, while Gemini offers the added capability of executing tasks and performing Google searches when needed.
Try the models!
Final Device
Our team has progressed to our final device, the SenSee. This compact board features an onboard camera and microphone while remaining energy-efficient. We’ve also designed a custom case with an integrated battery.
App Development
We’ve made significant progress on the mobile app that connects with our device. The app now supports voice activation, cancelling ongoing responses, and saving up to four custom replies using voice instead of text. Users can also send text-based queries and adjust the speech speed. All replies from the ESP32 are delivered directly back to the phone, allowing users to stay connected without switching away from their device.
Wristband Remote
Following feedback from our Guide Dogs testing, we’ve refined our remote device for the SenSee. The new design takes the form of a wristband featuring two simple buttons, one to start or stop recording, and another to cancel the current action.
Charging Dock
In addition to the wristband remote, the team has developed a custom charging dock for both devices. Each device securely clicks into its designated slot, with tactile markers on the front to help differentiate between them. Magnetic connectors allow the devices to automatically begin charging when placed in the dock.
