Experiencing Digital Literature – Reviews

Assessment Item 2 – Part A:

Chopsticks by Jessica Anthony and Rodrigo Corral

Chopsticks is an enhanced ebook (Lamb, 2011) published by Penguin Books for purchase as a mobile app for the iPad and iPhone. Using Unsworth’s categorisation, Chopsticks is a digitally originated literary text that utilises interactive elements and a variety of media (2005) to tell the story of Glory a sixteen-year-old piano prodigy. The app is aimed at young adult readers however adults may also be drawn to the unique presentation.

Chopsticks is “vastly different than a traditional novel” (Knapp, 2012, para 6). Prose is almost absent from this enhanced ebook (Lamb, 2011). The story is told using a combination of newspaper clippings, images, photo albums, letters, collages of personal belongings, instant messages and YouTube clips. The story opens with news reports detailing that a famous young pianist is missing.

Readers must be familiar with the functions of an iPad or iPhone to use the app and the menu screen provides an option to view instructions that explain the navigation features within the multi-sensory environment. “The emerging role of haptic perception in digital reading” (Roskos, Burnstein, Shang, & Gray, 2014, p.6) is increasing with enhanced ebook apps. Swiping, zooming, pinching and tapping the screen engage haptic perception. The app is better suited to the iPad screen with less zooming required than with the small iPhone screen. Readers that lack exposure to this technology may be resistant to engage with the text (Skains, 2010).

The multimodal format may be unsettling for readers unaccustomed to digital literature however the mystery surrounding Glory’s disappearance makes the reader curious and eager for more detail. Floating musical notes must be tapped to unlock or reveal sounds, words, images and video. The reader can gradually uncover these hidden features and discover more about the protagonist’s life. Roskos, Burnstein, Shang, & Gray believe “if physical actions offer a good cognitive and sensual “fit” with an unfolding narrative, then they may enhance engagement and deepen experience” (2014, p.6). The reader can become distracted if their attention is split however Chopsticks avoids this by offering the reader the choice of activating additional features such as music or video. The choices the reader makes can alter the meaning of the story.

Chopsticks can be read in two different ways. The ‘read’ option presents a linear story with chapters and the ‘shuffle read’ option is nonlinear. A reader’s prior experience with digital literature may determine how they engage with the text, with readers conditioned to reading linear stories having trouble adjusting to nonlinear storytelling (Skains, 2010). Enhanced ebooks have affordances that print does not have to present nonlinear storytelling.

Readers are invited to immerse themselves in the world of the two protagonists, Glory and Frank. Shared music playlists, YouTube clips and instant messaging reveals details of their developing relationship and emotional journey they are sharing despite being separated by distance. The technical capabilities of enhanced ebook apps “offers authors and readers of fiction additional methods and structures for interacting with narrative” (Skains, 2010, p. 97). This ebook app has been negatively impacted by technology and copyright constraints. For financial and technological reasons, the music and videos are linked to YouTube rather than embedded. “Viewing other content is not always a seamless process for the reader” (Hancox, 2013, para 12) and this is a weakness of this ebook app. The app was prone to freezing and crashing during the YouTube clips and this interrupted the flow of the story.

Writers of print fiction leave gaps to fill or unanswered questions for the reader to ponder, referred to as phase space. “The phase space is where the fictional “add-ons” to a story live: the back story, the extra details” (Bowler, 2012, p. 35). Chopsticks allows phase space by balancing scarce use of text and being careful to avoid overwhelming multimedia elements. The authors provide cues and clues but they have left a play space for the reader (Bowler, 2012). The reader is free to find his or her own meaning. The convergence of media in the app does not dictate meaning and the reader is guided to understand situations and emotions with room left to evoke their imagination (Walsh, 2013). With many schools now using iPads, English teachers could use this app for creative writing tasks around this phase space.

The motif of the Chopsticks musical piece is eloquently expressed using multimedia and illustrates the declining mental state of the young piano prodigy. The full potential of the media is realised when readers “utilize multiple sign systems including image, print, and sound” (Edwards, 2013, p. 51). The highly visual nature of the app evokes emotions and connects the reader intimately to the lives of the characters.

References

Bowler, L., Morris, R., Cheng, I., Al-Issa, R., Romine, B., & Leiberling, L. (2012). Multimodal stories: LIS students explore reading, literacy, and library service through the lens of “the 39 clues”. Journal of Education for Library and Information Science, 53(1), 32-48. Retrieved from http://search.proquest.com/docview/1239092155?accountid=10344

Edwards, J. T. (2013). Reading Beyond the Borders: Observations on Digital eBook Readers and Adolescent Reading Practices Technological Tools for the Literacy Classroom (pp. 135-158). Hershey, PA, USA: IGI Global.

Hancox, D. (2013). When books go digital: The Kills and the future of the novel. Retrieved from http://theconversation.com/when-books-go-digital-the-kills-and-the-future-of-the-novel-20098

Knapp, A. (2012). Are apps the future of book publishing? Retrieved from http://www.forbes.com/sites/alexknapp/2012/03/30/are-apps-the-future-of-book-publishing/

Lamb, A. (2011). Reading Redefined for a Transmedia Universe. Learning & Leading with Technology, 39(3), 12-17. Retrieved from http://ezproxy.csu.edu.au/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=ehh&AN=67371172&site=ehost-live

Roskos, K., Burstein, K., Shang, Y., & Gray, E. (2014). Young Children’s Engagement With E-Books at School. SAGE Open, 4(1). Retrieved from http://sgo.sagepub.com/content/4/1/2158244013517244.abstract

Skains, R. L. (2010). The Shifting Author—Reader Dynamic: Online Novel Communities as a Bridge from Print to Digital Literature. Convergence: The International Journal of Research into New Media Technologies, 16(1), 95-111. doi:10.1177/1354856509347713

Unsworth, L. (2005). E-literature for Children : Enhancing Digital Literacy Learning. Retrieved from http://CSUAU.eblib.com/patron/FullRecord.aspx?p=198496

Walsh, M. (2013). Literature in a digital environment. In L. McDonald (Ed.), A literature companion for teachers (pp. 181-194). Marrickville, NSW: Primary English Teaching Association Australia. Retrieved from https://www.csu.edu.au/division/library/ereserve/pdf/walsh-m3.pdf.

Firestorm By Jon Henley

Firestorm is an online interactive story produced by The Guardian and freely available and presented using a web browser. The story of the Holmes family’s dramatic experience of a the Dunalley bushfire in Tasmania is combined with information about the history of bushfires, fire fighting and climate change using multimedia. Also referred to as multimedia immersive journalism, digital narratives produced with software “enables the integration of aural, visual and sensory elements” (Walsh, 2013, p. 186). The multimodal and multimedia elements would suggest it would be categorised by Lamb (2011) as transmedia storytelling.

The “convergence of multiple media begins immediately” (James & de Kock, 2013, p. 115) with a dramatic photograph of the family sheltering from the bushfire augmented with audio from the fire fighters and text introducing the story. Immediately the setting of the story is conveyed and empathy for the family is established. According to Walsh (2013) good literature requires these elements so that the reader can “empathise with characters and their feelings, and imagine what it would be like if we were in them” (2013, p. 186).

The reader is motivated to learn more about the people in the photograph and is guided to scroll down to continue the story. While scrolling through a lengthy text can be arduous, in a highly visual linear medium such as Firestorm, scrolling is a strength instead of a weakness. (Jabr, 2013). The linear narrative is divided into six chapters in the same way a printed book would be. The leap from reading in print to reading on the screen is not as great using this format. “People know how to organize and manipulate paper documents, but manipulating electronic documents requires a different set of skills” (Liu, 2005, p. 702). The size and layout of the text has been carefully considered to avoid overwhelming the reader. It has been found that online reading exhausts our resources more and that “we read more efficiently when text is arranged in a single column” (Konnikova, 2014, para 4). The tendency to skim or scan the text in Firestorm is lessened by utilising a one-column presentation.

Much of the personal story is conveyed through the videos of Tim and Tammy Holmes speaking personally about their experiences. The videos are embedded seamlessly into the narrative and begin without any intervention from the reader. The affordance of the technical system controls the reader, draws them through the story and prevents them from getting lost (Bourchardon & Heckman, 2012). Reading flow is not disrupted by having to open a browser. Embedding short videos supplements the story and creates an atmosphere of fear, urgency and hope that cannot be expressed in words (Hancox, 2013). “The Guardian staff understands that with video, the images tell their own story. There’s no need to add text” (Johnson, 2013, para 12).

Detailed factual information and statistics about bushfires, the ecology of Tasmania, fire fighting and climate change provide context for the personal story. Text is relied on to a greater degree in this broader narrative with maps, infographics and videos used appropriately to supplement it (James & de Kock, 2013). The visual style resembles a long form magazine article that has been amplified with high quality media. “Overall their needs to be an aesthetic synergy between the technical features, the artistic creation of the text and the ideas within it” (Walsh, 2013, p. 187). Firestorm achieves this by subtle use of video and sound that does not distract the reader’s attention from the written text. The story is magnified and made authentic with images and video taken by the family, police, firefighters and residents at the time of the bushfire. Walsh (2013) believes good literature needs to be authentic for readers to make emotional and physical connections to the setting and characters. The two different narratives are woven together well and provide a good balance between personal and factual information.

Readers in a digital world are becoming accustomed to rich story experiences through news, social media and documentaries (James & de Kock, 2013). Firestorm leverages improved browser functionality to deliver an innovative digital non-fiction story “enhanced with affecting visuals” (James & de Kock, 2013 p. 110) that could be used in either a senior English or Geography classroom. The ease of access, clear navigation and limited transmedia elements, makes Firestorm an excellent introduction to interactive storytelling for readers with limited digital literacy.

References

Bouchardon, S., & Heckman, D. (2012). Digital manipulability and digital literature.   Retrieved from http://www.electronicbookreview.com/thread/electropoetics/heuristic

Hancox, D. (2013). When books go digital: The Kills and the future of the novel. Retrieved from http://theconversation.com/when-books-go-digital-the-kills-and-the-future-of-the-novel-20098

Jabr, F. (2013). The reading brain in the digital age: The science of paper versus screens. Scientific American. Retrieved from http://www.scientificamerican.com/article/reading-paper-screens/

James, R., & de Kock, L. (2013). The Digital David and the Gutenberg Goliath: The Rise of the ‘Enhanced’ e-book. English Academy Review, 30(1), 107-123. doi:10.1080/10131752.2013.783394

Johnson, S. (2013). Why the Guardian’s ‘Firestorm’ is better than the Times’ ‘Snowfall’. Retrieved from http://hudsoneclectic.com/?s=firestorm

Konnikova, M. (2014). Being a better online reader. Retrieved from http://www.newyorker.com/science/maria-konnikova/being-a-better-online-reader

Lamb, A. (2011). Reading Redefined for a Transmedia Universe. Learning & Leading with Technology, 39(3), 12-17. Retrieved from http://ezproxy.csu.edu.au/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=ehh&AN=67371172&site=ehost-live

Liu, Z. (2005). Reading behavior in the digital environment: Changes in reading behavior over the past ten years. Journal of Documentation, 61(6), 700-712. Retrieved from http://search.proquest.com/docview/217977973?accountid=10344

Walsh, M. (2013). Literature in a digital environment. In L. McDonald (Ed.), A literature companion for teachers (pp. 181-194). Marrickville, NSW: Primary English Teaching Association Australia. Retrieved from https://www.csu.edu.au/division/library/ereserve/pdf/walsh-m3.pdf.

Midnight Feast by Lynley Stace

Midnight Feast is an interactive picture book app published by Australian studio Slap Happy Harry and available for purchase from iTunes. “Interactive storybooks feature a narrator reading a linear story aloud” (Lamb, 2011, p. 14) and are accompanied by text and illustrations. The app is suitable for children nine years and over, however older children and teenagers may understand and interpret the story at a deeper level.

On entering the app, readers are greeted by a bright hand drawn artwork that serves as the menu to access options, individual pages and to start the book. The options allow the reader or teacher to turn narration on or off and there is an option to eliminate the “scary sauce” (Kirkus Review, 2013) to prevent younger children from being scared or confused by some of the content. The music is less foreboding and minor adjustments have been made to some scenes to suit younger readers. Depending on the age and technical ability of the reader, intervention by an adult may be required to negotiate new online reading literacies (Leu, 2011). The story starts with the reader briefly seeing an apartment building from a distance before being transported closer to peer through a window. A father is telling his daughter to get ready for bed but she wants to stay up late.

Text is overlaid on the muted illustration and narrated with appropriate tone (Yokota, 2014). A small arrow invites the reader to move forward. A corresponding backwards arrow is also provided to aid with comprehension (Jabr, 2013). Although it is not explicitly stated, tapping the screen activates dialogue, sound effects and actions by the characters. The muted, dark, shadowy illustrations transition, with a shimmery, dreamlike effect, to brighter, sharper illustrations as Roya’s imaginary world is evoked.

The thoughtfully used animation and introductory passage draws the reader into the story. Curious to know more about Roya and her little sister, the reader enables their kinesthetic use of touch and gesture to proceed (Walsh, 2013). The reader can discover hot spots that add finer details, motion and emotion to the story. These features amplify the narrative, however the story can be read and comprehended without uncovering them. The authors are not imposing amplification on the reader, instead they allow for spontaneous discovery of image and text. The hot spots are not used frivolously and maintain a good illustration and text match (Yokota, 2014). Pages (or screens) alternate between describing Roya’s life in a poor urban area and witnessing her reimagined life as midnight approaches.

The iPad ‘s interactive elements are not overwhelming; they are restrained and unobtrusive (Kirkus Review, 2013). Rub to reveal scenes are selectively used to involve the reader in manipulating Roya’s dream world. Randomly generated recipes and film titles seem like a gimmick at first but they may also intrigue the reader and lead to further research. There is synergy between the visual and tactile affordances that supports the literary experience (Roskos, 2014). The rich language includes metaphors, alliteration and other literary devices. The illustrations make the most of motifs, colour and symbolism to complement and improve on the text. A news report on the radio informs the reader of the dire situation Roya and her family lives in with food shortages and malnutrition a grim reality. A naïve reader may not understand the themes of food shortages, drought, and poverty but good literature can prompt readers to “consider issues and ideas through stories (Walsh 2013, p. 186).

Opportunities for word exploration using highlighted text are common in apps for younger children (Yokota, 2014). Midnight Feast targets a slightly older audience and does not highlight words as they are read. Struggling older readers would benefit if highlighted text were an option. The vocabulary is sophisticated and the lack of access to an inbuilt dictionary, for immediate on-demand help, is a weakness. (Bus, 2014). Readers could use the other affordances of the iPad and locate a dictionary however multitasking can disrupt immersive reading (Maloney, 2015) and negatively effect comprehension.

The Slap Happy Harry website contains additional resources for Midnight Feast. Close reading notes provide teachers with a screen-by-screen synopsis, pre-reading questions and other key questions for readers to consider. Activities for readers aged twelve to sixteen are available as a PDF document. These activities are extremely detailed, cover different curriculum areas and scaffold the text.

With its hidden depths, Midnight Feast “rewards the patient, deliberate user” (Grabarek, 2013, para 3). Subtle effects made possible within the iPad app environment augment the beautiful artwork and enhance meaning. Midnight Feast would work well in the classroom with themes ripe for discussion and as an outstanding example of an interactive storybook.

References

Bus, A. G., Takacs, Z. K., & Kegel, C. A. T. (2015). Affordances and limitations of electronic storybooks for young children’s emergent literacy. Developmental Review, 35, 79-97. doi:http://dx.doi.org/10.1016/j.dr.2014.12.004

Grabarek, D. (2012). The App review: best of Apps & enhanced books. School Library Journal, 58(4), 66. Retrieved from http://go.galegroup.com.ezproxy.csu.edu.au/ps/i.do?id=GALE%7CA285207457&v=2.1&u=csu_au&it=r&p=EAIM&sw=w&asid=28abfbb1157dc2229670ff04c6e68caa

Jabr, F. (2013). The reading brain in the digital age: The science of paper versus screens. Scientific American. Retrieved from http://www.scientificamerican.com/article/reading-paper-screens/

Lamb, A. (2011). Reading Redefined for a Transmedia Universe. Learning & Leading with Technology, 39(3), 12-17. Retrieved from http://ezproxy.csu.edu.au/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=ehh&AN=67371172&site=ehost-live

Leu, D.J. et al (2011). The new literacies of online reading comprehension: Expanding the literacy and learning curriculum. Journal of Adolescent & Adult Literacy,55(1)5-14. Doi: 10.1598/JAAL.55.1.1

Maloney, J. (2015). The rise of phone reading. The Wall Street Journal. Retrieved from http://www.wsj.com/articles/the-rise-of-phone-reading-1439398395

Midnight Feast. (2013). Kirkus Review. Retrieved from https://www.kirkusreviews.com/book-reviews/lynley-stace/midnight-feast/

Roskos, K., Burstein, K., Shang, Y., & Gray, E. (2014). Young Children’s Engagement With E-Books at School. SAGE Open, 4(1). Retrieved from http://sgo.sagepub.com/content/4/1/2158244013517244.abstract

Walsh, M. (2013). Literature in a digital environment. In L. McDonald (Ed.), A literature companion for teachers (pp. 181-194). Marrickville, NSW: Primary English Teaching Association Australia. Retrieved from https://www.csu.edu.au/division/library/ereserve/pdf/walsh-m3.pdf.

Yokota, J., & Teale, W. H. (2014). Picture Books and the Digital World. 67( 8), 585. Retrieved from – http://dx.doi.org/10.1002/trtr.1262

Leave a Reply