Open Captions

Posted: September 11th, 2011 | Author: | Filed under: technical | Tags: , , , , | 12 Comments »

[Updated with the latest status of Open Captions project]

I started building Open Captions for the Hackday TV hackathon at General Assembly.

Open Captions gives the viewers, the ability to search and view closed captioned YouTube videos. While watching the video, the viewer can select individual words of the closed captions and then see an American Sign Language Representation of the word on the screen. The viewer can also jump back to the previous caption showed on the screen. Whenever, a word is selected, the video automatically pauses when the ASL is showed on the page. The working prototype can be seen on Open Captions

Currently the project is a work in progress, and is susceptible to fail at a few places. Please feel free to email feedback, ideas, suggestions about Open Captions.

The ASL representation is just one of the use cases of Open Captions. This can be linked with Google Translate to find out words in other languages (very useful for people for whom English is not the first language). This can also be linked with say Wikipedia and children can learn about a word or a place spoken about on TV.

This idea of selecting words from closed captions also works for videos from Universal Subtitles, an initiative which helps create closed captions for videos on the Internet. Open Captions example with Universal Subtitles

Reference
The ASL representations are being scraped from www.cats.gatech.edu, which has around 25000 words shown in ASL in 25000 web pages.


12 Comments on “Open Captions”

  1. 1 Behold the Future of TV | Internet App developer support forum said at 10:34 pm on September 12th, 2011:

    [...] memorable presentation comes from Open Captions. The creator, Narayanan Ramakrishnan, designed software to both subtitle and provide American Sign [...]

  2. 2 Behold the Future of TV | Lisbon news said at 4:07 am on September 13th, 2011:

    [...] memorable presentation comes from Open Captions. The creator, Narayanan Ramakrishnan, designed software to both subtitle and provide American Sign [...]

  3. 3 Behold the Future of TV said at 6:32 am on September 13th, 2011:

    [...] memorable presentation comes fr&#959m Open Captions. Th&#1077 creator, Narayanan Ramakrishnan, designed software t&#959 both subtitle &#1072n&#1281 [...]

  4. 4 Narayanan Ramakrishnan » Blog Archive » Open Captions @Hackday TV | Social BK STYLE! | Scoop.it said at 9:02 pm on September 13th, 2011:

    [...] Narayanan Ramakrishnan » Blog Archive » Open Captions @Hackday TV [...]

  5. 5 The Winning Apps of New York's First Hackday.tv - Events said at 10:19 pm on September 13th, 2011:

    [...] Open Captions lets you access closed captions from YouTube videos. You can then select individual words and see an American Sign Language Representation on screen. [...]

  6. 6 The Winning Apps of New York’s First Hackday.tv | 1FENS said at 10:24 pm on September 13th, 2011:

    [...] &#79p&#101n Capti&#111ns l&#101&#116s y&#111u acc&#101ss cl&#111s&#101d cap&#116i&#111ns fr&#111m Y&#111u&#84ub&#101 &#118id&#101&#111s. Y&#111u can &#116h&#101n s&#101l&#101c&#116 indi&#118idual w&#111rds and s&#101&#101 an Am&#101rican Si&#103n Lan&#103ua&#103&#101 R&#101pr&#101s&#101n&#116a&#116i&#111n &#111n scr&#101&#101n. [...]

  7. 7 OnlineMagazine » Blog Archive » The Winning Apps of New York’s First Hackday.tv said at 10:24 pm on September 13th, 2011:

    [...] Open Captions lets you access closed captions from YouTube videos. You can then select individual words and see an American Sign Language Representation on screen. [...]

  8. 8 The Winning Apps of New York’s First Hackday.tv | souqdeals.com said at 11:27 pm on September 13th, 2011:

    [...] Open Captions lets you access closed captions from YouTube videos. You can then select individual words and see an American Sign Language Representation on screen. [...]

  9. 9 The Winning Apps of New York’s First Hackday.tv | | AAACBCAAACBC said at 12:21 am on September 14th, 2011:

    [...] Open Captions lets you access closed captions from YouTube videos. You can then select individual words and see an American Sign Language Representation on screen. [...]

  10. 10 The Winning Apps of New York’s First Hackday.tv | GeekForThought said at 12:21 am on September 14th, 2011:

    [...] Open Captions lets you access closed captions from YouTube videos. You can then select individual words and see an American Sign Language Representation on screen. [...]

  11. 11 Arkid said at 7:03 pm on September 14th, 2011:

    Wonderful hack!!! Loved it :)

  12. 12 Behold the Future of TV said at 5:29 am on September 17th, 2011:

    [...] memorable presentation comes from Open Captions. The creator, Narayanan Ramakrishnan, designed software to both subtitle and provide American Sign [...]