It deserves a minor rewrite of the Black Mirror episode Fifteen Million Merits where people do menial labor like folding laundry and washing dishes to earn tokens so that their LLM will dispense their toothpaste and send Studio Ghibli stylized birthday cards to their friends.
Probably 1,000 for the system prompt, 400 for the audio speech-to-text, 8 for the query, 180 for the thinking, 12 for the tool call, 33 for the response with a useless follow-up question
This project isn’t tightly coupled with anything. Any service that supports WebRTC should work!
Also I was hoping to push people toward a RTOS. Better experience then a raspberry pi, I can cycle power and be back way quicker. Also cheaper/more power efficient.
I also think I unfairly like ESP because it’s an excuse to write C :)
I see so much potential if I can make hardware hacking + WebRTC easy. Not just for AI assistants but security cameras + robotics. If anyone has questions/ideas/feedback here to help :)
You can use it to build lots of different real-time communication projects. Conferencing, Send your audio/video to GPU servers for AI, broadcasting and lots more.
I get that this is as-is, but I wonder if so many ultra-alpha products don't dilute the OpenAI brand and create redundancy in the product line. It feels like the opposite of Apple's well thought out planned product design and product line.
This is just a hackathon project. Not a product in any way.
My primary work is on backend WebRTC servers. This was just an outlet/fun side thing to do client and embedded work. I love writing C and do microcontrollers. I just can’t seem to find a way to do it full time:(
For a developer platform having examples is useful as a starting point for new projects.
Also, I’m not sure if it’s similar at OpenAI, but when I was at Google it was much easier to get approval to put an open source project under the Google GitHub org than my personal user.
https://gist.github.com/mgarratt/afb3b57a08e2eb2479eb6083a86...
https://www.xda-developers.com/ollama-ai-comparison-raspberr...
https://www.xda-developers.com/raspberry-pi-voice-assistant-...
https://www.youtube.com/watch?v=o1sN1lB76EA
Also I was hoping to push people toward a RTOS. Better experience then a raspberry pi, I can cycle power and be back way quicker. Also cheaper/more power efficient.
I also think I unfairly like ESP because it’s an excuse to write C :)
I see so much potential if I can make hardware hacking + WebRTC easy. Not just for AI assistants but security cameras + robotics. If anyone has questions/ideas/feedback here to help :)
You can use it to build lots of different real-time communication projects. Conferencing, Send your audio/video to GPU servers for AI, broadcasting and lots more.
It’s a super fun space to be in
https://m.youtube.com/watch?v=HbO18Elw9WY
Are two that I know of. Try it out, if you hit any roadblocks @ me on pipecat discord and would love to help
https://www.youtube.com/watch?v=G5OUnpPAyCg
I was tempted to put Erik Satie in the README video. Didn’t want to risk copyright issues
Let's see if it pays out.
My primary work is on backend WebRTC servers. This was just an outlet/fun side thing to do client and embedded work. I love writing C and do microcontrollers. I just can’t seem to find a way to do it full time:(
Also, I’m not sure if it’s similar at OpenAI, but when I was at Google it was much easier to get approval to put an open source project under the Google GitHub org than my personal user.
It's possible those investments are just the oai owners selling their 2023 chatgpt success and its profit share.