DEV Community

Discussion on: Improve Video Accessibility with Captions

Collapse
 
rhymes profile image
rhymes

Love the idea of generating and embedding transcriptions, thanks Gift!

Collapse
 
lauragift21 profile image
Gift Egwuenu

Awesome! I'm glad you liked it.

Collapse
 
rhymes profile image
rhymes

Thanks for inspiring me to write this feature request:

Add automatic transcription to video articles on upload #6649

rhymes avatar
rhymes commented on Mar 16, 2020

Is your feature request related to a problem? Please describe.

Inspired by this DEV post by @lauragift21 about adding automatic captions with Cloudinary I thought it might be nice to consider having something similar for DEV.

The post details how it can be done via Cloudinary, essentially using either of these services:

The services create machine generated transcriptions.

As we don't upload directly to Cloudinary (but to S3 and let Cloudinary fetch from there) I'm not sure if we can use those add-ons but maybe they can be invoked passing the URL of the S3 uploaded and transcoded video.

AWS also has its own similar service AWS Transcribe which can be used via API. See also this tutorial: Create an Audio Transcript

Describe the solution you'd like

It should definitely be a per video setting during upload (enabled by default) and there might be privacy considerations by using an external service but this is how I imagine it works:

  • the video gets uploaded to S3
  • Google's, Microsoft's or Amazon's transcription service is invoked (we could test them all to see which one is the most accurate)
  • the transcription is added to the video shown to the users, with a button to display/hide it, like [CC] for YouTube videos

Additional context

Bonus: let the user download, edit and reupload the transcripts to their own videos

:-)

Collapse
 
lauragift21 profile image
Gift Egwuenu

Oh wow! Happy to see this as a feature request it'll be a huge improvement to an already amazing platform :)