User Experience Testing in the Open Textbook Adaptation Workflow
A Case Study
As library publishers and open education programs grow, it is imperative that we integrate practices in our workflows that prioritize and include end users. Although there is information available on best practices for user testing and accessibility compliance, more can be done to give insight into the library publishing context. This study examines the user and accessibility testing workflow during the modification of an existing open textbook using Pressbooks at Texas Tech University.
Academic Student Ebook Experience Survey Report (Library Journal Research, 2018): 6, accessed May 3, 2019, https://mediasource.formstack.com/forms/2018_academic_student_ebook_experience_survey_report.
Amanda Coolidge et al., Accessibility Toolkit - 2nd Edition (Victoria, B.C.: BCcampus, 2018), 1–71, https://opentextbc.ca/accessibilitytoolkit/.
André Constantino da Silva et al., “Portability and Usability of Open Educational Resources on Mobile Devices: A Study in the Context of Brazilian Educational Portals and Android-Based Devices” (paper, International Conference on Mobile Learning 2014, Madrid, Spain, February 28–March 2, 2014), 198, https://eric.ed.gov/?id=ED557248.
Andy Arana et al. eds., “Open Logic Project,” University of Calgary Faculty of Arts and the Campus Alberta OER Initiative, accessed April 26, 2019, http://openlogicproject.org/.
Andy Lane, “From Pillar to Post: Exploring the Issues Involved in Repurposing Distance Learning Materials for Use as Open Educational Resources” (working paper, UK Open University, December 2006), accessed August 1, 2018, http://kn.open.ac.uk/public/document.cfm?docid=9724.
Anita R. Walz, “Open and Editable: Exploring Library Engagement in Open Educational Resource Adoption, Adaptation and Authoring,” Virginia Libraries 61 (January 2015): 23, http://hdl.handle.net/10919/52377.
Ariana E. Santiago, OER Adoption Workflow - Visual Overview, April 2019, accessed July 14, 2020, https://docs.google.com/drawings/d/1cZQHpGpQyrr46Vm5IytOEMYQj-s1zr0P-M-LJ16Rtto/.
Beth St. Jean et al., “Unheard Voices: Institutional Repository End-Users,” College & Research Libraries 72, no. 1 (January 2011): 23, https://doi.org/10.5860/crl-71r1.
Billy Meinke, “Discovering OER Production Workflows,” UH OER (blog), University of Hawai’i, December 23, 2016, https://oer.hawaii.edu/discovering-oer-production-workflows/.
Christina Mune and Ann Agee, “Ebook Showdown: Evaluating Academic Ebook Platforms from a User Perspective,” in Creating Sustainable Community: The Proceedings of the ACRL 2015 Conference (2015): 25–28.
“CORRE 2.0,” Institute of Learning Innovation, University of Leicester, accessed April 25, 2019, https://www2.le.ac.uk/departments/beyond-distance-research-alliance/projects/ostrich/corre-2.0.
Cynthia Ng, “A Practical Guide to Improving Web Accessibility,” Weave: Journal of Library User Experience 1, no. 7 (2017), https://doi.org/10.3998/weave.12535642.0001.701.
Danielle A. Becker and Lauren Yannotta, “Modeling a Library Website Redesign Process: Developing a User-Centered Website Through Usability Testing,” Information Technology and Libraries 32, no. 1 (March 2013): 9–10.
Diane Harley, “Why Understanding the Use and Users of Open Education Matters,” in Opening Up Education: The Collective Advancement of Education through Open Technology, Open Content, and Open Knowledge, ed. Toru Iiyoshi and M.S. Vijay Kumar (Cambridge, MA: The MIT Press, 2008), 197–212.
Erin Dorris Cassidy, Michelle Martinez, and Lisa Shen, “Not in Love, or Not in the Know? Graduate Student and Faculty Use (and Non-Use) of E-books,” The Journal of Academic Librarianship 38, no. 6 (2012): 326–32.
Esta Tovstiadi, Natalia Tingle, and Gabrielle Wiersma, “Academic E-book Usability from the Student’s Perspective,” Evidence Based Library and Information Practice 13, no. 4 (2018): 70–87.
Helen Timperley et al., Teacher Professional Learning and Development (Wellington, New Zealand: Ministry of Education, 2007), http://www.oecd.org/education/school/48727127.pdf.
Jakob Nielsen and Thomas K. Landauer, “A Mathematical Model of the Finding of Usability Problems,” in Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems (May 1993): 211–12, https://doi.org/10.1145/169059.169166.
Jessica Norman, SAIT OER Workflow, May 2019, accessed July 14, 2020, https://docs.google.com/drawings/d/1XVJpU9S4Bb32K3GblNVw4uy1Ely9rTXnr8bkFDM5-yk/.
Jo R. Jardina and Barbara S. Chaparro, “Investigating the Usability of E-Textbooks Using the Technique for Human Error Assessment,” Journal of Usability Studies 10, no. 4 (2015): 140–59.
Joelle Thomas and Galadriel Chilton, “Library E-Book Platforms Are Broken: Let’s Fix Them,” Academic E-Books: Publishers, Librarians, and Users (2016): 249–62.
Jutta Treviranus et al., “An Introduction to the FLOE project,” in International Conference on Universal Access in Human-Computer Interaction, Universal Access to Information and Knowledge, ed. Constantine Stephanidis and Margherita Antona, UAHCI 2014 (June 2014), Lecture Notes in Computer Science 8514: 454, https://doi.org/10.1007/978-3-319-07440-5_42.
Krista Godfrey, “Creating a Culture of Usability,” Weave: Journal of Library User Experience 1, no. 3 (2015), https://doi.org/10.3998/weave.12535642.0001.301.
Laura Icela González-Pérez, María-Soledad Ramírez-Montoya, and Francisco J. García-Peñalvo, “User Experience in Institutional Repositories: A Systematic Literature Review,” International Journal of Human Capital and Information Technology Professionals 9, no. 1 (January–March 2018): 79, 84, https://doi.org/10.4018/IJHCITP.2018010105.
Laura Muir and Graeme Hawes, “The Case for E-Book Literacy: Undergraduate Students’ Experience with E-Books for Course Work,” The Journal of Academic Librarianship 39, no. 3 (2013): 260–74.
Maria Nuccilli, Elliot Polak, and Alex Binno, “Start with an Hour a Week: Enhancing Usability at Wayne State University Libraries,” Weave: Journal of Library User Experience 1, no. 8 (2018), https://doi.org/10.3998/weave.12535642.0001.803.
Michael Gorrell, “The eBook User Experience in an Integrated Research Platform,” Against the Grain 23, no. 5 (December 2014): 38.
“Our Team,” OpenStax, Rice University, accessed December 9, 2019, https://openstax.org/team.
Peter Morville, “User Experience Design,” Semantic Studios, June 21, 2004, http://semanticstudios.com/user_experience_design/.
Rebecca Blakiston and Shoshana Mayden, “How We Hired a Content Strategist (And Why You Should Too),” Journal of Web Librarianship 9, no. 4 (2015): 202–6, https://doi.org/10.1080/19322909.2015.1105730.
Regina Gong, OER Production Workflow, accessed July 14, 2020, http://libguides.lcc.edu/oer/adopt.
Robert Slater, “Why Aren’t E-Books Gaining More Ground in Academic Libraries? E-Book Use and Perceptions: A Review of Published Literature and Research,” Journal of Web Librarianship 4, no. 4 (2010): 305–31.
Robin DeRosa, The Open Anthology of Earlier American Literature (Public Commons Publishing, 2015), https://openamlit.pressbooks.com/.
Samuel K. Nikoi et al., “CORRE: A Framework for Evaluating and Transforming Teaching Materials into Open Educational Resources,” Open Learning: The Journal of Open, Distance and e-Learning 26, no. 3 (2011), 194–99, https://doi.org/10.1080/02680513.2011.611681.
Sarah Crissinger, “A Critical Take on OER Practices: Interrogating Commercialization, Colonialism, and Content,” In the Library with the Lead Pipe, October 21, 2015, http://www.inthelibrarywiththeleadpipe.org/2015/a-critical-take-on-oer-practices-interrogating-commercialization-colonialism-and-content/.
Sarah Morehouse, “OER Bootcamp 3-3: OERs and Usability,” YouTube video, 3:16, March 2, 2018, https://www.youtube.com/watch?v=CnCXbcS-2gM.
Scott Woodward, Adam Lloyd, and Royce Kimmons, “Student Voice in Textbook Evaluation: Comparing Open and Restricted Textbooks,” International Review of Research in Open and Distributed Learning 18, no. 6 (September 2017), 150–63, https://doi.org/10.19173/irrodl.v18i6.3170.
Simone Borsci et al., “Reviewing and Extending the Five-User Assumption: A Grounded Procedure for Interaction Evaluation,” in ACM Transactions on Computer-Human Interaction 20, no. 5, article 29 (November 2013), 18–19, http://delivery.acm.org/10.1145/2510000/2506210/a29-borsci.pdf.
Sonya Betz and Robyn Hall, “Self-archiving with Ease in an Institutional Repository: Microinteractions and the User Experience,” Information Technology and Libraries 34, no. 3 (September 21, 2015): 44–45, https://doi.org/10.6017/ital.v34i3.5900.
Stephen Whitfield and Zoe Robinson, “Open Educational Resources: The Challenges of ‘Usability’ and Copyright Clearance,” Planet 25, no. 1 (2012): 52, https://doi.org/10.11120/plan.2012.00250051.
Steve Krug, Rocket Surgery Made Easy (Berkeley, CA: New Riders, 2010), 146–53.
Steven D. Eppinger, Murthy V. Nukala, and Daniel E. Whitney, “Generalised Models of Design Iteration Using Signal Flow Graphs,” Research in Engineering Design 9, no. 2 (1997): 112.
Timothy Robbins, “Case Study: Expanding the Open Anthology of Earlier American Literature,” in A Guide to Making Open Textbooks with Students, ed. Elizabeth Mays (The Rebus Community for Open Textbook Creation, 2017), https://press.rebus.community/makingopentextbookswithstudents/chapter/case-study-expanding-open-anthology-of-earlier-american-literature/.
Tom Carey and Gerard L. Hanley, “Extending the Impact of Open Educational Resources through Alignment with Pedagogical Content Knowledge and Institutional Strategy: Lessons Learned from the MERLOT Community Experience,” in Opening Up Education: The Collective Advancement of Education through Open Technology, Open Content, and Open Knowledge, ed. Toru Iiyoshi and M.S. Vijay Kumar (Cambridge, MA: The MIT Press, 2008), 238.
Vassilis Kourbetis and Konstantinos Boukouras, “Accessible Open Educational Resources for Students with Disabilities in Greece,” in Universal Access in Human-Computer Interaction, Universal Access to Information and Knowledge, ed. Constantine Stephanidis and Margherita Antona, UAHCI 2014 (June 2014), Lecture Notes in Computer Science 8514: 349–57, https://doi.org/10.1007/978-3-319-07440-5_32.
Whitney Quesenbery, “Usable Accessibility: Making Web Sites Work Well for People with Disabilities,” UX Matters, February 23, 2009, http://www.uxmatters.com/mt/archives/2009/02/usable-accessibility-making-web-sites-work-well-for-people-with-disabilities.php.
Zoe Wake Hyde, “Accessibility and Universal Design,” in Pressbooks for EDU Guide (Pressbooks.com, 2016), https://www.publiconsulting.com/wordpress/eduguide/.
Copyright (c) 2021 Camille Thomas, Kimberly Vardeman, Jingjing Wu
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.