Difference between revisions of "RealTimeCaptions"
Line 16: | Line 16: | ||
== Text layout, format == | == Text layout, format == | ||
− | [http://psych.utoronto.ca/~muter/pmuter1.htm] Muter, Paul (1996) '''Interface design and optimization of reading of continous text. ''' In van Oostendorp, H., and de Mul. S. (eds.) '''Cognitive aspects of electronic text processing. ''' Norwood, NJ: Ablex. | + | {| border="1" cellspacing="0" cellpadding="5" align="center" |
− | + | ! Source | |
− | + | ! Note | |
− | + | |- | |
− | + | | [http://psych.utoronto.ca/~muter/pmuter1.htm] Muter, Paul (1996) '''Interface design and optimization of reading of continous text. ''' In van Oostendorp, H., and de Mul. S. (eds.) '''Cognitive aspects of electronic text processing. ''' Norwood, NJ: Ablex. | |
+ | |concise overview of conclusions about computer text format/layout/scrolling vs. paging/etc. (based on various studies) | ||
+ | |- | ||
− | [http://www.springerlink.com/content/w68124503575664j/fulltext.pdf] Wald, M. and Bain, K. (2007) '''Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation.''' In: HCI International 2007: 12th International Conference on Human-Computer Interaction, 22-27 July, Beijing. | + | |[http://delivery.acm.org/10.1145/50000/46162/p329-mills.pdf?key1=46162&key2=1342626421&coll=GUIDE&dl=GUIDE&CFID=42984143&CFTOKEN=28220885] Bergfeld Mills, Carol and Linda Weldon. '''Reading Text from Computer Screens.''' ACM Computing Surveys, Vol. 19, No. 4, December 1987. (329-357) |
− | + | |format/layout studies + “When text was scrolled as a block, recall was significantly better than when text was scrolled sentence by sentence” | |
− | + | |- | |
− | [http://www.springerlink.com/content/m1385223612467n2/fulltext.pdf] Kohtaroh Miyamoto, et al. '''Integration of Caption Editing System with Presentation Software''' HCI International 2007 | + | | [http://www.springerlink.com/content/w68124503575664j/fulltext.pdf] Wald, M. and Bain, K. (2007) '''Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation.''' In: HCI International 2007: 12th International Conference on Human-Computer Interaction, 22-27 July, Beijing. |
− | + | |changing / customizing display to make captions more readable | |
− | + | |- | |
− | [http://web.ebscohost.com/ehost/detail?vid=2&hid=8&sid=1bd87239-87f2-438a-bb9b-851c063b2c43%40sessionmgr7&bdata=JnNpdGU9ZWhvc3QtbGl2ZQ%3d%3d#db=rzh&AN=1999070306] Steinfeld Aaron. '''The benefit of real-time captioning in a mainstream classroom as measured by working memory.''' Volta Review, 1998 Winter; 100(1): 29-44. | + | |[http://www.springerlink.com/content/m1385223612467n2/fulltext.pdf] Kohtaroh Miyamoto, et al. '''Integration of Caption Editing System with Presentation Software''' HCI International 2007 |
− | + | |a study dealing with layout of components/ presentation | |
+ | |- | ||
+ | |[http://web.ebscohost.com/ehost/detail?vid=2&hid=8&sid=1bd87239-87f2-438a-bb9b-851c063b2c43%40sessionmgr7&bdata=JnNpdGU9ZWhvc3QtbGl2ZQ%3d%3d#db=rzh&AN=1999070306] Steinfeld Aaron. '''The benefit of real-time captioning in a mainstream classroom as measured by working memory.''' Volta Review, 1998 Winter; 100(1): 29-44. | ||
+ | |Mentions that 4 lines is optimal for onscreen realtime captions | ||
+ | |} | ||
== Captioning info == | == Captioning info == | ||
− | [http://books.google.com/books?id=-8bPkkVYuOAC&pg=PA167&dq=CART+captioning&lr=&ei=UetGSs79NpnOMb-liakO&client=firefox-a] Downey, Gregory John. '''Closed captioning: subtitling, stenography, and the digital convergence of text with television.'''JHU Press, 2008 | + | {| border="1" cellspacing="0" cellpadding="5" align="center" |
− | + | ! Source | |
− | + | ! Note | |
− | [http://netac.rit.edu/downloads/TFR_RTCaptioning.pdf] Stinson, Michael, et al. (1999) '''Real-Time Speech-to-Text Services: [A Report of the] National Task Force on Quality of Services in the Postsecondary Education of Deaf and Hard of Hearing Students.''' Northeast Technical Assistance Center, Rochester Institute of Technology. | + | |- |
− | + | |[http://books.google.com/books?id=-8bPkkVYuOAC&pg=PA167&dq=CART+captioning&lr=&ei=UetGSs79NpnOMb-liakO&client=firefox-a] Downey, Gregory John. '''Closed captioning: subtitling, stenography, and the digital convergence of text with television.'''JHU Press, 2008 | |
− | + | |book all about captioning | |
− | [http://delta.ncsu.edu/docs/about/captioning.pdf] Rhyne, Theresa-MT and Lisa Fiedor. '''Examining Open and Closed Captioning Options for Multimedia & Online Instruction at North Carolina State University.''' Learning Technology Service. North Carolina State University. | + | |- |
− | + | |[http://netac.rit.edu/downloads/TFR_RTCaptioning.pdf] Stinson, Michael, et al. (1999) '''Real-Time Speech-to-Text Services: [A Report of the] National Task Force on Quality of Services in the Postsecondary Education of Deaf and Hard of Hearing Students.''' Northeast Technical Assistance Center, Rochester Institute of Technology. | |
− | + | |how some captioning systems work | |
− | [http://books.google.com/books?id=cJmZ_JIxwNwC&pg=PA198&dq=multimedia+instruction+captioning&lr=&ei=PElJSsvZIJTQlAThkNWWDQ&client=firefox-a] Lesser, Brian et al. '''Programming Flash Communication Server.''' O'Reilly, 2005 (197-205). | + | |- |
− | + | |[http://delta.ncsu.edu/docs/about/captioning.pdf] Rhyne, Theresa-MT and Lisa Fiedor. '''Examining Open and Closed Captioning Options for Multimedia & Online Instruction at North Carolina State University.''' Learning Technology Service. North Carolina State University. | |
− | + | |overview of captioning web-based content (flash, realtime, quicktime) | |
− | [http://www.springerlink.com/content/u1021835th2wj012/fulltext.pdf] Lambourne, Andrew, et al. (2004) '''Speech-Based Real-Time Subtitling Services''' INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY 7, 269–279.Kluwer Academic Publishers. | + | |- |
− | + | |[http://books.google.com/books?id=cJmZ_JIxwNwC&pg=PA198&dq=multimedia+instruction+captioning&lr=&ei=PElJSsvZIJTQlAThkNWWDQ&client=firefox-a] Lesser, Brian et al. '''Programming Flash Communication Server.''' O'Reilly, 2005 (197-205). | |
− | + | |captioning and syncing in Flash (info about video as well) | |
− | [http://www.research.ibm.com/journal/sj/443/bain.html] Bain, Keith et al. (2005) '''Accessibility, transcription, and access everywhere.''' IBM Systems Journal archive Volume 44 , Issue 3 (August 2005) (589 - 603). | + | |- |
− | + | |[http://www.springerlink.com/content/u1021835th2wj012/fulltext.pdf] Lambourne, Andrew, et al. (2004) '''Speech-Based Real-Time Subtitling Services''' INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY 7, 269–279.Kluwer Academic Publishers. | |
− | + | |SpeakTitle (live subtitling system) development | |
− | [http://books.google.com/books?hl=en&lr=&id=Mj_GJaOgXokC&oi=fnd&pg=PA207&dq=%22real-time+captioning%22+font&ots=KtMcM5Yy52&sig=XA1WHgHe-Q1XLGAF3JlmX99hntk] | + | |- |
− | Kanevsky, Dimitri, et al. 2008. '''Speech transformation solutions.''' In '''Cognition Distributed: How Cognitive Technology Extends Our Minds''', Dror, Itiel E. and Stevan Harnad (eds.), 207–235. | + | |[http://www.research.ibm.com/journal/sj/443/bain.html] Bain, Keith et al. (2005) '''Accessibility, transcription, and access everywhere.''' IBM Systems Journal archive Volume 44 , Issue 3 (August 2005) (589 - 603). |
− | + | |IBM on transcription | |
+ | |- | ||
+ | |[http://books.google.com/books?hl=en&lr=&id=Mj_GJaOgXokC&oi=fnd&pg=PA207&dq=%22real-time+captioning%22+font&ots=KtMcM5Yy52&sig=XA1WHgHe-Q1XLGAF3JlmX99hntk] Kanevsky, Dimitri, et al. 2008. '''Speech transformation solutions.''' In '''Cognition Distributed: How Cognitive Technology Extends Our Minds''', Dror, Itiel E. and Stevan Harnad (eds.), 207–235. | ||
+ | |mechanisms of transcription and how certain goals are met | ||
+ | |} | ||
== Effect of real-time captioning on education for the deaf == | == Effect of real-time captioning on education for the deaf == | ||
− | [http://jdsde.oxfordjournals.org/cgi/reprint/11/4/421] Marschark, Marc, et al. (2006) '''Benefits of Sign Language Interpreting and Text Alternatives for Deaf Students' Classroom Learning.''' Journal of Deaf Studies and Deaf Education 421-437 | + | {| border="1" cellspacing="0" cellpadding="5" align="center" |
− | + | ! Source | |
− | + | ! Note | |
− | [http://sed.sagepub.com/cgi/rapidpdf/0022466907313453v1.pdf] Stinson, Michael S. et al. '''Deaf and Hard-of-Hearing Students’ Memory of Lectures With Speech-to-Text and Interpreting/Note Taking Services.''' The Journal of Special Education, Vol. 43, No. 1, 52-64 (2009) | + | |- |
− | + | |[http://jdsde.oxfordjournals.org/cgi/reprint/11/4/421] Marschark, Marc, et al. (2006) '''Benefits of Sign Language Interpreting and Text Alternatives for Deaf Students' Classroom Learning.''' Journal of Deaf Studies and Deaf Education 421-437 | |
+ | |effectiveness of text & ASL interpretation of lectures for deaf students | ||
+ | |- | ||
+ | |[http://sed.sagepub.com/cgi/rapidpdf/0022466907313453v1.pdf] Stinson, Michael S. et al. '''Deaf and Hard-of-Hearing Students’ Memory of Lectures With Speech-to-Text and Interpreting/Note Taking Services.''' The Journal of Special Education, Vol. 43, No. 1, 52-64 (2009) | ||
+ | |effectiveness of text/Asl interpreting of lectures for deaf students | ||
+ | |} |
Revision as of 04:23, 1 July 2009
[1] Pan, Y., Jiang, D., Picheny, M., and Qin, Y. (2009) Effects of real-time transcription on non-native speaker's comprehension in computer-mediated communications. Proceedings of the 27th International Conference on Human Factors in Computing Systems CHI '09. ACM, New York, NY, 2353-2356.
[2] Wald, M. and Bain, K. (2007) Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation. HCI International 2007: 12th International Conference on Human-Computer Interaction, 22-27.
[3] The National Association of the Deaf and The Described and Captioned Media Program. Captioning Key for Educational Media.
- much of the (very detailed) guidelines here are mainly relevant for captioners themselves. One section on "Text" is the only part relevant for ClassInFocus.
[4] Cardinal, P., Boulianne, G., Comeau, M., and Boisvert, M. (2007) Real-Time Correction of Closed-Captions. Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, 113-116.
- correcting errors in captions
Text layout, format
Source | Note |
---|---|
[5] Muter, Paul (1996) Interface design and optimization of reading of continous text. In van Oostendorp, H., and de Mul. S. (eds.) Cognitive aspects of electronic text processing. Norwood, NJ: Ablex. | concise overview of conclusions about computer text format/layout/scrolling vs. paging/etc. (based on various studies) |
[6] Bergfeld Mills, Carol and Linda Weldon. Reading Text from Computer Screens. ACM Computing Surveys, Vol. 19, No. 4, December 1987. (329-357) | format/layout studies + “When text was scrolled as a block, recall was significantly better than when text was scrolled sentence by sentence” |
[7] Wald, M. and Bain, K. (2007) Enhancing the Usability of Real-Time Speech Recognition Captioning through Personalised Displays and Real-Time Multiple Speaker Editing and Annotation. In: HCI International 2007: 12th International Conference on Human-Computer Interaction, 22-27 July, Beijing. | changing / customizing display to make captions more readable |
[8] Kohtaroh Miyamoto, et al. Integration of Caption Editing System with Presentation Software HCI International 2007 | a study dealing with layout of components/ presentation |
[9] Steinfeld Aaron. The benefit of real-time captioning in a mainstream classroom as measured by working memory. Volta Review, 1998 Winter; 100(1): 29-44. | Mentions that 4 lines is optimal for onscreen realtime captions |
Captioning info
Source | Note |
---|---|
[10] Downey, Gregory John. Closed captioning: subtitling, stenography, and the digital convergence of text with television.JHU Press, 2008 | book all about captioning |
[11] Stinson, Michael, et al. (1999) Real-Time Speech-to-Text Services: [A Report of the] National Task Force on Quality of Services in the Postsecondary Education of Deaf and Hard of Hearing Students. Northeast Technical Assistance Center, Rochester Institute of Technology. | how some captioning systems work |
[12] Rhyne, Theresa-MT and Lisa Fiedor. Examining Open and Closed Captioning Options for Multimedia & Online Instruction at North Carolina State University. Learning Technology Service. North Carolina State University. | overview of captioning web-based content (flash, realtime, quicktime) |
[13] Lesser, Brian et al. Programming Flash Communication Server. O'Reilly, 2005 (197-205). | captioning and syncing in Flash (info about video as well) |
[14] Lambourne, Andrew, et al. (2004) Speech-Based Real-Time Subtitling Services INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY 7, 269–279.Kluwer Academic Publishers. | SpeakTitle (live subtitling system) development |
[15] Bain, Keith et al. (2005) Accessibility, transcription, and access everywhere. IBM Systems Journal archive Volume 44 , Issue 3 (August 2005) (589 - 603). | IBM on transcription |
[16] Kanevsky, Dimitri, et al. 2008. Speech transformation solutions. In Cognition Distributed: How Cognitive Technology Extends Our Minds, Dror, Itiel E. and Stevan Harnad (eds.), 207–235. | mechanisms of transcription and how certain goals are met |
Source | Note |
---|---|
[17] Marschark, Marc, et al. (2006) Benefits of Sign Language Interpreting and Text Alternatives for Deaf Students' Classroom Learning. Journal of Deaf Studies and Deaf Education 421-437 | effectiveness of text & ASL interpretation of lectures for deaf students |
[18] Stinson, Michael S. et al. Deaf and Hard-of-Hearing Students’ Memory of Lectures With Speech-to-Text and Interpreting/Note Taking Services. The Journal of Special Education, Vol. 43, No. 1, 52-64 (2009) | effectiveness of text/Asl interpreting of lectures for deaf students |