I recently came across an open-source project called WorldCupVoice and thought it was worth sharing.
Quick note first: I’m not the creator.
The project is by zicojiao.
The demo makes the idea click immediately: this is not a post-game recap system. It watches a live match feed and speaks over the action in real time.
Project links:
- GitHub: https://github.com/zicojiao/worldcupvoice
- Reddit: https://www.reddit.com/r/OpenAI/comments/1udx8it/i_tried_making_an_ai_world_cup_commentator_it/
What makes this project interesting is that it is not a “generate a match summary later” system.
It is a live pipeline:
- a match feed comes in through RTMP
- Agora converts it into a real-time RTC stream
- the backend samples frames from the live video
- OpenAI generates grounded play-by-play commentary
- TTS turns that into speech
- the generated audio is published back into the same RTC room
What I found especially interesting from reading the README and code is that the project is clearly trying to solve a harder problem than image captioning.
The prompts appear to push the model toward a live football commentator role by constraining it to:
- comment on visible action rather than narrate loosely
- avoid inventing off-screen goals or fouls
- use player names only when visual evidence is strong enough
- return
NO_CALLwhen the frame is not readable enough
Another thing I liked was that the project seems to take operational reality seriously.
It includes explicit Start AI / Stop AI controls, viewer heartbeat, and a hard session TTL, which makes a lot of sense for a live AI system where cost can keep growing even when nobody is watching.
The World Cup framing is fun, but the accessibility angle might be even more compelling.
A system like this could potentially add more field-level spatial detail for blind and low-vision fans than traditional commentary often does.
Again, I’m not the author, so if I’m misreading any implementation detail, happy to be corrected. But as an open-source example of a real-time multimodal media pipeline, this was one of the more interesting projects I’ve come across recently.
Full credit to zicojiao for the project itself. I’m only sharing it because I found it worth discussing.
Top comments (0)