Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (CC-BY-NC-SA 4.0)?
No comments here
Why not start the discussion?
Skip to main contentMarientina’s List
CTIN 510 • Weekly Readings & Library
Course supplement to plan your explorations.
Published onJan 08, 2023
CTIN 510 • Weekly Readings & Library
Weekly Readings
All resources are freely available via the USC library, via Interlibrary Loan (ILIAD)[1], or via the ARES Course Reserves. If you encounter paywalls, you are not searching through the right channel. Be sure to link your Google Scholar account with the USC Library.
Week 1 – Introduction
Masterclass “How research can make your games better?”
Week 2 – Basic research skills and concepts
Enhancing the quality and transparency of health research (or social science and other research)
Kamp, M. a, Slotty, P., Sarikaya-Seiwert, S., Steiger, H.-J., & Hänggi, D. (2011). Traumatic brain injuries in illustrated literature: Experience from a series of over 700 head injuries in the Asterix comic books. Acta Neurochirurgica, 153(6), 1351–1355; discussion 1355. https://doi.org/10.1007/s00701-011-0993-6
Ellis, C., Adams, T. E., & Bochner, A. P. (2010). Autoethnography: An Overview. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 12(1). https://doi.org/10.17169/fqs-12.1.1589
Week 3 – The art of literature reviews
PRISMA on Scoping Reviews (Includes the PRISMA checklist, an explainer video, and tips)
In USC SAGE: Byrne, D. (2017). Reviewing the literature. Project Planner. https://dx.doi.org/10.4135/9781526408518. USC link
Paré, G., Trudel, M. C., Jaana, M., & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information and Management, 52(2), 183–199. https://doi.org/10.1016/j.im.2014.08.008
Scoping review samples:
Kwok, I., & Wescott, A. B. (2020). Cyberintimacy: A scoping review of technology-mediated romance in the digital Age. Cyberpsychology, Behavior, and Social Networking, 23(10), 657–666. https://doi.org/10.1089/cyber.2019.0764
Ravenek, K. E., Wolfe, D. L., & Hitzig, S. L. (2015). A scoping review of video gaming in rehabilitation. Disability and Rehabilitation: Assistive Technology, 00(00), 1–9. https://doi.org/10.3109/17483107.2015.1029538
Crampton, N. H., Reis, S., & Shachak, A. (2016). Computers in the clinical encounter: A scoping review and thematic analysis. Journal of the American Medical Informatics Association, 23(3), 654–665. https://doi.org/10.1093/jamia/ocv178
Akhtar, M. H., & Ramkumar, J. (2023). Primary Health Center: Can it be made mobile for efficient healthcare services for hard to reach population? A state-of-the-art review. Discover Health Systems, 2(1), 3. https://doi.org/10.1007/s44250-023-00017-x
Evans, L., Evans, J., Pagliari, C., & Källander, K. (2023). Scoping review: Exploring the equity impact of current digital health design practices. Oxford Open Digital Health, 1, oqad006. https://doi.org/10.1093/oodh/oqad006
Lokmic-Tomkins, Z., Bhandari, D., Bain, C., Borda, A., Kariotis, T. C., & Reser, D. (2023). Lessons learned from natural disasters around digital health technologies and delivering quality healthcare. International Journal of Environmental Research and Public Health, 20(5), 4542. https://doi.org/10.3390/ijerph20054542
Week 4 – Introduction to interviewing methods and qualitative coding methods
Chapter 1 in: Brinkmann, S. (2013). Qualitative Interviewing. Oxford University Press. https://doi.org/10.1093/acprof:osobl/9780199861392.001.0001
(USC eBook link)In USC SAGE: Map of interviewing concepts and methods (USC Link)
Charmaz, K. (2017). Interviewing. (USC Link) (less than 3 mins)
Laurie Ph.D., C., & Jensen Ph.D., E. (2017). An introduction to interviews and focus groups (USC Link) (17 mins)
Deep dives:
Roulston, K. (2010). Designing studies that use interviews. In Reflective interviewing: A guide to theory and practice (pp. 74-95). SAGE Publications Ltd, https://www-doi-org.libproxy1.usc.edu/10.4135/9781446288009
Hewitt, J. (2007). Ethical components of researcher—Researched relationships in qualitative interviewing. Qualitative Health Research, 17(8), 1149–1159. https://doi.org/10.1177/1049732307308305
Guillemin, M., & Heggen, K. (2012). The narrative approach as a learning strategy in the formation of novice researchers. Qualitative Health Research, 22(5), 700–707. https://doi.org/10.1177/1049732311431443
Harris, A., & Guillemin, M. (2012). Developing sensory awareness in qualitative interviewing: A portal into the otherwise unexplored. Qualitative Health Research, 22(5), 689–699. https://doi.org/10.1177/1049732311431899
Soiferman, L. K. (2010). Compare and contrast inductive and deductive research approaches (ED542066; p. 23). ERIC. https://eric.ed.gov/?id=ED542066
Week 5 – Guest lecture - Games and Human-Computer Interaction Methods
Medlock, M. C. (2018). The Rapid Iterative Test and Evaluation Method (RITE). Games User Research, 203–215. https://doi.org/10.1093/oso/9780198794844.003.0013
Medlock, M. C., Lead, U. T., Studios, M. G., Wixon, D., Manager, U., Terrano, M., Designer, G., & Studios, E. (2002). Using the RITE method to improve products: A definition and a case study. Usability Professionals Association. https://jpattonassociates.com/wp-content/uploads/2015/04/rite_method.pdf
Chapter 15 in:
Drachen, A., Mirza-Babaei, P., & Nacke, L. (2018). Games User Research. Oxford University Press. https://doi.org/10.1093/oso/9780198794844.001.0001 (USC eBook)
Tractinsky, N. (2018). The Usability Construct: A Dead End? Human–Computer Interaction, 33(2), 131–177. https://doi.org/10.1080/07370024.2017.1298038
Moreno-Ger, P., Torrente, J., Hsieh, Y. G., & Lester, W. T. (2012). Usability testing for serious games: Making informed design decisions with user data. Advances in Human-Computer Interaction, 2012. https://doi.org/10.1155/2012/369637
Wixon, D. (2003). Evaluating usability methods. Interactions, 10(4), 28–34. https://doi.org/10.1145/838830.838870
Bonus material:
Medlock, M. C., Wixon, D., McGee, M., & Welsh, D. (2005). The rapid iterative test and evaluation method: Better products in less time. In Cost-Justifying Usability (pp. 489–517). Elsevier Inc. https://doi.org/10.1016/B978-012095811-5/50017-1
Borsci, S., Macredie, R. D., Martin, J. L., & Young, T. (2014). How many testers are needed to assure the usability of medical devices? Expert Review of Medical Devices, 11(5), 513–525. https://doi.org/10.1586/17434440.2014.940312
Nielsen, J. (2000). Why You Only Need to Test with 5 Users. http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
Nielsen, J., & Landauer, T. K. (1993). A mathematical model of the finding of usability problems. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI ’93, 206–213. https://doi.org/10.1145/169059.169166
Week 6 – Introduction to constructing and selecting questionnaires
Wixon, D. (2011). Measuring fun, trust, confidence, and other ethereal constructs. Interactions, 18(6), 74. https://doi.org/10.1145/2029976.2029995
Intrinsic Motivation Inventory (make an account and download the packet)
eBook Reference Guide:
Peterson, R. A. (2000). Constructing effective questionnaires. SAGE Publications, Inc. (USC Link)
Current consensus:
Committee on Measuring Sex, Gender Identity, and Sexual Orientation, Committee on National Statistics, Division of Behavioral and Social Sciences and Education, & National Academies of Sciences, Engineering, and Medicine. (2022). Measuring sex, gender identity, and sexual orientation (N. Bates, M. Chin, & T. Becker, Eds.; p. 26424). National Academies Press. https://doi.org/10.17226/26424
Critical perspective:
Spiel, K. (2021). ”Why are they all obsessed with Gender?”—(Non)binary Navigations through Technological Infrastructures. Designing Interactive Systems Conference 2021, 478–494. https://doi.org/10.1145/3461778.3462033
Deep dive:
Tyack, A., & Mekler, E. D. (2020). Self-determination theory in HCI games research: Current uses and open questions. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1–22. https://doi.org/10.1145/3313831.3376723
Week 7 – Ethnographic Interviewing and Analysis
(See Presentations folder in GDrive).
Week 8 – Introduction to analysis of survey data and basic statistics
Wendi’s List (ordered by duration)
1. Distributions in JMP
Getting Started with JMP, Part 3: Basic Statistics (21’, more advanced)
2. Distributions in general
The Shape of Data: Distributions: Crash Course Statistics (11:22 - lots of visuals, simple and explains definitions well)
3. Normality
Assessing Normality (2:31 - Assessing Normality in JMP)
Testing For Normality (9:56)
4. Central limit theorem
Central limit theorem (3:42)
Introduction to the Central Limit Theorem (13:13 - including reviews about mean, SD concepts)
5. Variable types: ordinal, nominal, etc
Types of Variables: Discrete, Continuous & Categorical (3:25)
Variables and Types of Variables (13:12 - more detailed on definitions and categorized)
6. Five number summaries in JMP
The Five Number Summary (5:37 - concepts)
Five Number Summary & Boxplots in JMP (5:06 - how to do this in JMP)
Data Summary and Analysis in JMP (58:11)
7. Box plots, bar charts, histograms
Comparing dot plots, histograms, and box plots (5:25 - title says for 6th grade but I don’t think so...)
Bar Charts, Pie Charts, Histograms, Stemplots, Timeplots (7:34)
Marientina’s List
How to Use SPSS: Choosing the Appropriate Statistical Test (47m)
(this is mistitled; it is really a crash course on how to get from research question to research design to analysis and it is very complete; you can apply the same to JMP as this is NOT an SPSS tutorial )Kinds of data (2 min cheat sheet)
Variables and Types of Variables (13 mins)
Analysis of Likert Data (16min - summarizes well the debate on how to categorize the variables in 16 minutes)
Can Likert Scale Data ever be Continuous? (short summary of key points in this very hot classic nerdy debate)
Week 9 – Introduction to interdisciplinary topics of ethics in research
Sample research protocols in GDrive.
NIH History of Ethics Protections (Retro Film, 22 min, super dramatic with amazing historical footage!)
Mark Israel Discusses Ethics in Research (30 mins, broken up in segments PDF transcript available)
Wendy Hein discusses Thinking Through and Doing Transformative, Feminist Marketing Research (30 mins, broken up in segments, PDF transcript available)
Vijay Kanagala discusses Tips for Decolonizing Qualitative Research Studies (9 mins, PDF transcript available)
Bonus materials (try to read at least 2 articles):
Madary, M., & Metzinger, T. K. (2016). Real virtuality: A code of ethical conduct. Recommendations for good scientific practice and the consumers of VR-technology. Frontiers Robotics AI, 3(FEB), 1–23. https://doi.org/10.3389/frobt.2016.00003
Gotsis, M., & Jordan-Marsh, M. (2018). Calling HCI professionals into health research: Patient safety and health equity at stake. Proceedings of the 22nd Pan-Hellenic Conference on Informatics - PCI ’18, 213–218. https://doi.org/10.1145/3291533.3291562
Karppinen, P., & Oinas-Kukkonen, H. (2013). Three approaches to ethical considerations in the design of behavior change support systems. In S. Berkovsky & J. Freyne (Eds.), Persuasive 2013 (pp. 87–98). Springer-Verlag. https://doi.org/10.1007/978-3-642-37157-8_12
Brown, B., Weilenmann, A., McMillan, D., & Lampinen, A. (2016). Five provocations for ethical HCI research. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 852–863. https://doi.org/10.1145/2858036.2858313
Spiel, K., & Gerling, K. (2020). The Purpose of play: How HCI games research fails neurodivergent populations. 1(1), 1–41. https://katta.mere.st/wp-content/uploads/2020/11/neurodiv_play_preprint.pdf
Vines, J., McNaney, R., Clarke, R., Lindsay, S., McCarthy, J., Howard, S., Romero, M., & Wallace, J. (2013). Designing for- and with- vulnerable people. CHI ’13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA ’13, 3231. https://doi.org/10.1145/2468356.2479654
Burr, C., Taddeo, M., & Floridi, L. (2020). The ethics of digital well-being: A thematic review. In Science and Engineering Ethics (Vol. 26, Issue 4). Springer Netherlands. https://doi.org/10.1007/s11948-020-00175-8
Alexander, S. J. (2010). “As long as it helps somebody”: Why vulnerable people participate in research. In International Journal of Palliative Nursing (Vol. 16, Issue 4, pp. 173–178). MA Healthcare Ltd. https://doi.org/10.12968/ijpn.2010.16.4.47783
Archibald, M. M., & Gerber, N. (2018). Arts and mixed methods research: An innovative methodological merger. American Behavioral Scientist, 62(7), 956–977. https://doi.org/10.1177/0002764218772672
Lynch, B. (2020). Introduction: Neither helpful nor unhelpful–a clear way forward for the useful museum. In Museums and Social Change (pp. 1-32). Routledge.
Recommended movies (in ARES Course Reserves)
Crip Camp (2020) - Down the road from Woodstock, a revolution blossomed at a ramshackle summer camp for teenagers with disabilities, transforming their lives and igniting a landmark movement. A film that showcases radical inclusivity and activism for young people with disabilities.
First Language (2014) - An Emmy Award-winning documentary that chronicles the efforts of the Eastern Band of Cherokee Indians to preserve and revitalize the endangered Cherokee language. An exemplary project of community-based research and education programs led by insiders.
Miss Evers’ Boys (1997) - The true story of the U.S. Government's 1932 Tuskegee Syphilis Experiment, in which a group of black test subjects were allowed to die, despite a developed cure. A film about one of the most famous ethical violations in medical research.
Picture A Scientist - K-12 Edition(2020) - Despite the minimal news coverage, sexual harassment and gender inequality against women are no less prevalent in science than they are in pop culture and corporate America. A film that demonstrates the costs of exclusion and discrimination in science.
Week 10 – No class - Spring break
Week 11 – Intermediate qualitative research methods
Chapter 1 from Saldaña manual in GDrive.
McDonald, N., Schoenebeck, S., & Forte, A. (2019). Reliability and inter-rater reliability in qualitative research. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–23. https://doi.org/10.1145/33591741
Week 12 – Intermediate statistical methods
See resources in class GDrive.
Week 13 – Project triage
Week 14 – Longitudinal research methods in games
Gotsis, M., Wang, H., Spruijt-Metz, D., Jordan-Marsh, M., & Valente, T. W. (2013). Wellness Partners: Design and evaluation of a web-based physical activity diary with social gaming features for adults. Journal of Medical Internet Research, 15(2), 1–14. https://doi.org/10.2196/resprot.2132
Gesell, S. B., Barkin, S. L., & Valente, T. W. (2013). Social network diagnostics: A tool for monitoring group interventions. Implementation Science : IS, 8(1), 116. https://doi.org/10.1186/1748-5908-8-116
Week 15 – Guest lecture - TBD special topic
TBD.
Week 16 – Project triage
BOOKS ON METHODS
Brinkmann, S. (2013). Qualitative Interviewing. Oxford University Press. https://doi.org/10.1093/acprof:osobl/9780199861392.001.0001
(USC eBook link)
Committee on Measuring Sex, Gender Identity, and Sexual Orientation, Committee on National Statistics, Division of Behavioral and Social Sciences and Education, & National Academies of Sciences, Engineering, and Medicine. (2022). Measuring sex, gender identity, and sexual orientation (N. Bates, M. Chin, & T. Becker, Eds.; p. 26424). National Academies Press. https://doi.org/10.17226/26424
Hammond, M., & Wellington, J. (2020). Research Methods; The Key Concepts; Second Edition (2nd ed.). Routledge. (USC Link)
Lankoski, P., & Bjork, S. (Eds.). (2015). Game Research Methods: An Overview. ETC Press. Available here.
Drachen, A., Mirza-Babaei, P., & Nacke, L. (2018). Games User Research. Oxford University Press. (USC Link)
Select chapters added in ARES Course Reserves (pending):
Esposito, J., & Evans-Winters, V. (2021). Introduction to Intersectional Qualitative Research. SAGE Publications.
Pink, S., Lanzeni, D., Duque, M., Sumartojo, S., & Strengers, Y. (2022). Design ethnography: Research, responsibilities, and futures. Routledge.
Saldaña, J. (2013). The Coding Manual for Qualitative Researchers. SAGE Publications. (or 2009 which is available online via Google as a scanned PDF)
Saldaña, J., & Omasta, M. (2021). Qualitative Research: Analyzing Life (2nd ed.). SAGE Publications.
SPECIAL INTEREST ARTICLES & SHORTS
Durham, Aisha. An introduction to the autoethnographic method. London, United Kingdom: SAGE Publications Ltd, 2017. VIDEO@USC: https://uosc-primo-exlibrisgroup-com.libproxy1.usc.edu/permalink/01USC_INST/hs9vaa/alma991042648690103731 (10 minutes)
Bliss, L. A., & Rocco, T. S. (2013). “Mind the gap”: Qualitative researchers and mixed methods research. 2003 COERC, 25–30. http://digitalcommons.fiu.edu/cgi/viewcontent.cgi?article=1025&context=sferc&sei-redir=1&referer=http://scholar.google.com/scholar?q=“Mind+the+gap”%3A+Qualitative+Researchers+and+Mixed+Methods+Rese
Michelle O’Reilly, & Nisha Dogra. (2017). Designing your interview study. In Interviewing children and young people for research (p. 15–). SAGE Publications Ltd. https://doi.org/10.4135/9781526419439.n2
(USC eBook link)
O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89(9), 1245–1251. https://doi.org/10.1097/ACM.0000000000000388
Duncan, L. R., Hieftje, K. D., Culyba, S., & Fiellin, L. E. (2014). Game playbooks: Tools to guide multidisciplinary teams in developing videogame-based behavior change interventions. Translational Behavioral Medicine, 4(1), 108–116. https://doi.org/10.1007/s13142-013-0246-8
Teddlie, C., & Yu, F. (2007). Mixed methods sampling. Journal of Mixed Methods Research, 1(1), 77–100. https://doi.org/10.1177/1558689806292430
Topics in Autoethnography
Lapadat, J. C. (2017). Ethics in autoethnography and collaborative autoethnography. Qualitative Inquiry, 23(8), 589–603. https://doi.org/10.1177/1077800417704462
Pelias, R. J. (2019). Writing autoethnography. Writing Performance, Identity, and Everyday Life, 1(4), 31–52. https://doi.org/10.4324/9781351111751-3
Wessner, P. B. (2021). Finding hope. Journal of Autoethnography, 2(3), 355–358. https://doi.org/10.1525/joae.2021.2.3.355
