Twitter subtitling

Last updated

Twitter subtitling is the process of using live or recorded tweets from the backchannel to create subtitles for video content. The use of 'twitter subtitling' has mainly been used to enhance the video archive of live events (e.g. television broadcasts, conferences etc.).

Contents

Development history

The concept of combining video and Twitter feeds for recorded events was first proposed Tom Smith in February 2009 [1] after experiencing Graham Linehan's BadMovieClub [2] in which at 9pm exactly on 13 February 2009, over 2,000 Twitter users simultaneously pressed 'Play' on the film 'The Happening' and continued to 'tweet' whilst watching, creating a collective viewing experience.

Smith, in response, proposed that media such as DVDs and YouTube videos could be enhanced by overlaying asynchronous status updates from other Twitter users who had watched the same media. [1]

Separately, in March 2009 Tony Hirst (Open University), in consultation with Liam Green-Hughes (Open University), presented a practical solution for creating SubRip (*.srt) subtitle files from the Twitter Search API using Yahoo Pipes. The resulting file was then uploaded to a YouTube video [3] allowing users to replay in realtime audio/video with an overlay of status updates from Twitter. Hirst subsequently revisited his original solution creating the simplified Twitter Subtitle web interface for the original Yahoo Pipe [4]

The concept was revisited on 16 February 2010 by Martin Hawksey (Jisc RSC Scotland North & East) in response to a notification by Hirst made via Twitter during a broadcast of the BBC/OU's The Virtual Revolution series in which Hirst requested information on replaying the #bbcrevolution hashtag in real-time. [5]

Hawksey presented a solution, using Hirst's example from 2009, that created a subtitle file from tweets in W3C Timed Text Markup Language (TTML) which could be used with the BBC iPlayer. [6] Hawksey, following support from Hirst, [7] subsequently extended the Twitter Subtitles Generator tool to include: SubRip (*.srt) creation; and SMIL 3.0 smilText creation and real-time playback. [8]

Development of the Twitter Subtitle Generator has continued with support to directly play embeddable YouTube and Vimeo HTML5 videos [9] and following a suggestion from Hirst [10] the ability to use the Twitter subtitles to navigate within the video timeline. [11]

Examples of use

Related Research Articles

Closed captioning Process of displaying interpretive texts to screens

Closed captioning (CC) and subtitling are both processes of displaying text on a television, video screen, or other visual display to provide additional or interpretive information. Both are typically used as a transcription of the audio portion of a program as it occurs, sometimes including descriptions of non-speech elements. Other uses have included providing a textual alternative language translation of a presentation's primary audio language that is usually burned-in to the video and unselectable.

The Matroska Multimedia Container is a free and open container format, a file format that can hold an unlimited number of video, audio, picture, or subtitle tracks in one file. It is a universal format for storing common multimedia content, like movies or TV shows. Matroska is similar in concept to other containers like AVI, MP4, or Advanced Systems Format (ASF), but is entirely open in specification, with implementations consisting mostly of open source software. Matroska file extensions are .mkv for video, .mk3d for stereoscopic video, .mka for audio-only files, and .mks for subtitles only.

WinDVD

WinDVD is a commercial video player and music player software for Microsoft Windows. It enables the viewing of DVD-Video movies on the user's PC. DVD-Video backups stored on hard disk can also be played. The player can also be used to play videos and audio/music files in other formats encoded with different codecs, for instance DivX, Xvid, Windows Media Video video and MP3 and AAC audio. Newer versions also support full Blu-ray Disc and HD DVD playback with menus, with CPRM DRM support.

VLC media player Free and open-source media player and streaming media server

VLC media player is a free and open-source, portable, cross-platform media player software and streaming media server developed by the VideoLAN project. VLC is available for desktop operating systems and mobile platforms, such as Android, iOS and iPadOS. VLC is also available on digital distribution platforms such as Apple's App Store, Google Play, and Microsoft Store.

RealPlayer Media player app

RealPlayer, formerly RealAudio Player, RealOne Player and RealPlayer G2, is a cross-platform media player app, developed by RealNetworks. The media player is compatible with numerous container file formats of the multimedia realm, including MP3, MP4, QuickTime File Format, Windows Media format, and the proprietary RealAudio and RealVideo formats. RealPlayer is also available for other operating systems; Linux, Unix, Palm OS, Windows Mobile, and Symbian versions have been released.

The following comparison of video players compares general and technical information for notable software media player programs.

These tables compare features of multimedia container formats, most often used for storing or streaming digital video or digital audio content. To see which multimedia players support which container format, look at comparison of media players.

SubRip is a free software program for Microsoft Windows which extracts subtitles and their timings from various video formats to a text file. It is released under the GNU GPL. Its subtitle format's file extension is .srt and is widely supported. Each .srt file is a human-readable file format where the subtitles are stored sequentially along with the timing information. Most subtitles distributed on the Internet are in this format.

DirectVobSub is a software add-on for Microsoft Windows that is able to read external subtitle files and superimposes them on a playing video file.

SubStation Alpha

SubStation Alpha, abbreviated SSA, is a subtitle file format created by CS Low that allows for more advanced subtitles than the conventional SRT and similar formats. It is also the name of the popular, now discontinued tool used to edit subtitles.

Timed text refers to the presentation of text media in synchrony with other media, such as audio and video.

KMPlayer Freeware media player for Microsoft Windows

K-Multimedia Player is an Adware-supported media player for Windows and iOS that can play most current audio and video formats, including VCD, HDML, DVD, AVI, MKV, Ogg, OGM, 3GP, MPEG-1/2/4, AAC, WMA 7, 8, WMV, RealMedia, FLV and QuickTime. KMPlayer shows many advertisements, including in the homepage, side panels, options panel, and as pop-up ads.

GOM Player Media player

GOM Player is a media player for Windows, developed by GOM & Company. With more than 100 million downloads, it is also known as the most used player in South Korea. Its main features include the ability to play some broken media files and find missing codecs using a codec finder service.

Subtitles Textual representation of events and speech in motion imagery

Subtitles are text derived from either a transcript or screenplay of the dialogue or commentary in films, television programs, video games, and the like, always displayed at the bottom of the screen, and at the top of the screen if there is already text at the bottom of the screen as per the Oxford English Definition. They can either be a form of written translation of a dialogue in a foreign language, or a written rendering of the dialogue in the same language, with or without added information to help viewers who are deaf or hard-of-hearing, who cannot understand the spoken language, or who have accent recognition problems to follow the dialogue.

DVD-Video Format used to store digital video on DVD discs

DVD-Video is a consumer video format used to store digital video on DVD discs. DVD-Video was the dominant consumer home video format in Asia, North America, Europe, and Australia in the 2000s until it was supplanted by the high-definition Blu-ray Disc. Discs using the DVD-Video specification require a DVD drive and an MPEG-2 decoder. Commercial DVD movies are encoded using a combination MPEG-2 compressed video and audio of varying formats. Typically, the data rate for DVD movies ranges from 3 to 9.5 Mbit/s, and the bit rate is usually adaptive. DVD-Video was first available in Japan on November 1, 1996, followed by a release on March 24, 1997 in the United States—to line up with the 69th Academy Awards that same day.

A subtitle editor is a type of software used to create and edit subtitles to be superimposed over, and synchronized with, video. Such editors usually provide video preview, easy entering/editing of text, start, and end times, and control over text formatting and positioning. Subtitle editors are available as standalone applications, as components of many video editing software suites, and as web applications.

GNOME Videos Media player software of the desktop environment GNOME

GNOME Videos, formerly known as Totem, is a media player for the GNOME computer desktop environment. GNOME Videos uses the Clutter and GTK+ toolkits. It is officially included in GNOME starting from version 2.10, but de facto it was already included in most GNOME environments. Totem utilizes the GStreamer framework for playback, though until version 2.27.1, it could alternatively be configured to use the Xine libraries instead of GStreamer.

Tony Hirst is an academic in the Department of Computing and Communications at the Open University, but better known for the OUseful Blog on practical applications of open data.

Rakuten Viki is an American video streaming website. It streams videos similar to other services, but also allows users to subtitle content available in 200 languages as well as provides original programming. Headquartered in San Mateo, California, it has offices in Singapore, Tokyo, Japan, and Seoul, South Korea.

BBC Redux is a BBC Research & Development system that digitally records television and radio output in the United Kingdom produced by the British Broadcasting Corporation. It has been operating since 2007 and contains several petabytes of recordings and subtitle data. It is notable for being the proof of concept for the Flash video streaming version of the BBC iPlayer.

References

  1. 1 2 "How Two Jokers De-Zombified the Film Industry with Twitter". Tom Smith's theotherblog. Archived from the original on 6 January 2011. Retrieved 20 July 2010.
  2. "BadMovieClub website". Badmovieclub.co.uk. Retrieved 22 July 2010.
  3. 1 2 "Twitter Powered Subtitles for Conference Audio/Videos on Youtube". OUseful.Info. 8 March 2009. Retrieved 12 July 2010.
  4. "Easier Twitter Powered Subtitles for Youtube Movies". OUseful.Info. 17 March 2009. Retrieved 12 July 2010.
  5. "Twitter / Tony Hirst: Hmmm, mulling over how to ..." Twitter. Retrieved 12 July 2010.
  6. "Twitter powered subtitles for BBC iPlayer". RSC MASHe. 16 February 2010. Retrieved 12 July 2010.
  7. "Twitter Powered Subtitles for BBC iPlayer Content c/o the MASHe Blog". OUseful.Info. 17 February 2010. Retrieved 12 July 2010.
  8. "Twitter powered subtitles: Creation and playback for SMIL 3.0 SMILText, *.srt and Timed Text (BBC iPlayer)". RSC MASHe. 23 February 2010. Retrieved 12 July 2010.
  9. "Twitter subtitles on Vimeo using HTML5". RSC MASHe. April 2010. Retrieved 12 July 2010.
  10. "Searching the Backchannel – Martin Bean, OU VC, Twitter Captioned at JISC10". OUseful.Info. 19 April 2010. Retrieved 12 July 2010.
  11. "Searching the backchannel with Twitter subtitles". RSC MASHe. 20 April 2010. Retrieved 12 July 2010.
  12. "The Virtual Revolution: Twitter subtitles for BBC iPlayer". RSC MASHe. 20 February 2010. Retrieved 5 January 2016.
  13. "Gordon Brown's Building Britain's Digital Future announcement with twitter subtitles". RSC MASHe. 23 March 2010. Retrieved 12 July 2010.
  14. "JISC10 Conference Keynotes with Twitter Subtitles". RSC MASHe. 19 April 2010. Retrieved 12 July 2010.
  15. "What they were saying: Leaders debate on BBC iPlayer with twitter subtitles from parliamentary candidates". RSC MASHe. 3 May 2010. Retrieved 12 July 2010.
  16. "Google I/O 2010 – Keynote Day 2 Android Demo with Twitter Subtitles". RSC MASHe. 24 May 2010. Retrieved 12 July 2010.
  17. "Institutional Web Management Workshop 2010 – Plenary Talks". UKOLN. Retrieved 22 July 2010.
  18. "iTitle: Full circle with Twitter subtitle playback in YouTube (ALT-C 2010 Keynotes)". RSC MASHe. November 2010. Retrieved 1 November 2010.