{"id":32,"date":"2022-07-28T09:02:32","date_gmt":"2022-07-28T09:02:32","guid":{"rendered":"https:\/\/metric.qcri.org\/blog\/?p=32"},"modified":"2022-07-28T09:02:33","modified_gmt":"2022-07-28T09:02:33","slug":"think-aloud-surveys-a-method-for-eliciting-enhanced-insights-during-user-studies","status":"publish","type":"post","link":"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/think-aloud-surveys-a-method-for-eliciting-enhanced-insights-during-user-studies\/","title":{"rendered":"Think-Aloud Surveys &#8211; A Method for Eliciting Enhanced Insights During User Studies"},"content":{"rendered":"\n<p>In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method.<\/p>\n\n\n\n<p>We coin the phrase \u201cthink-aloud survey method\u201d, where participants think-aloud while completing a questionnaire.<\/p>\n\n\n\n<p>We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants\u2019 Likert scale choices and responses to open-ended questions, along with an enhanced understanding of the tasks and prompting the participants to explicate their choices. All resulting in more insights for design.<\/p>\n\n\n\n<p>The think- aloud survey method further offers other insights into usability issues and encourages the participants to provide system improvement proposals.<\/p>\n\n\n\n<p>The think-aloud survey method is useful for researchers and practitioners applying a large number of usability evaluations and wanting to dig deeper into the motivations for choice.<\/p>\n\n\n\n<p>Nielsen, L., Salminen, J., Jung, S.G., and\u00a0Jansen, B. J.\u00a0(2021)\u00a0<a rel=\"noreferrer noopener\" href=\"http:\/\/www.bernardjjansen.com\/uploads\/2\/4\/1\/8\/24188166\/nielsen2021_chapter_think-aloudsurveys.pdf\" target=\"_blank\">Think-Aloud Surveys &#8211; A Method for Eliciting Enhanced Insights During User Studies<\/a>, INTERACT 2021 18th IFIP TC13 International Conference on Human\u2013Computer Interaction. 30 Aug. &#8211; 3 Sept. Bari, Italy.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In a user experiment, we tried out a novel data collection approach consisting of combining surveys with the think aloud method. We coin the phrase \u201cthink-aloud survey method\u201d, where participants think-aloud while completing a questionnaire. We analyzed the transcripts and found that the think aloud survey provides deeper insights into the reasoning behind the participants\u2019 &#8230; <a title=\"Think-Aloud Surveys &#8211; A Method for Eliciting Enhanced Insights During User Studies\" class=\"read-more\" href=\"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/think-aloud-surveys-a-method-for-eliciting-enhanced-insights-during-user-studies\/\" aria-label=\"More on Think-Aloud Surveys &#8211; A Method for Eliciting Enhanced Insights During User Studies\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-32","post","type-post","status-publish","format-standard","hentry","category-user-study"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":112,"url":"https:\/\/metric.qcri.org\/blog\/2023\/06\/21\/why-are-user-feedback-and-user-testing-important\/","url_meta":{"origin":32,"position":0},"title":"Why are User feedback and User testing important?","date":"June 21, 2023","format":false,"excerpt":"User feedback and user testing play a significant role in developing and improving digital products such as websites and mobile applications as it helps businesses understand their users. Understanding people, their characteristics, capabilities, commonalities, and differences allows designers to create more effective, safer, efficient, and enjoyable systems [2]. Here are\u2026","rel":"","context":"In \"engagement\"","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2023\/06\/image-3.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":168,"url":"https:\/\/metric.qcri.org\/blog\/2024\/03\/14\/some-insights-and-recommendations-about-user-studies\/","url_meta":{"origin":32,"position":1},"title":"Some insights and recommendations about user studies","date":"March 14, 2024","format":false,"excerpt":"We have published a series of research articles examining user studies, including implementation suggestions. Some insights and recommendations about user studies Some of our findings and recommendations are: Fair pay: Paying crowdworkers adequately is task dependent Real Users: Students are overused in academic studies; there are workable alternates to get\u2026","rel":"","context":"Similar post","img":{"alt_text":"Some insights and recommendations about user studies","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/03\/insights_into_user_studies_jansen.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":36,"url":"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/comparing-persona-analytics-and-social-media-analytics-for-a-user-centric-task-using-eye-tracking-and-think-aloud\/","url_meta":{"origin":32,"position":2},"title":"Comparing Persona Analytics and Social Media Analytics for a User-Centric Task Using Eye-Tracking and Think-Aloud","date":"July 28, 2022","format":false,"excerpt":"We compare a data-driven persona system and an analytics system for efficiency and effectiveness for a user identification task. Findings from the 34-participant experiment show that the data-driven persona system affords faster task completion, is easier for users to engage with, and provides better user identification accuracy. Eye-tracking data indicates\u2026","rel":"","context":"In &quot;user study&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":282,"url":"https:\/\/metric.qcri.org\/blog\/2024\/07\/04\/actionable-data-creating-personas-from-metric-data-analytics\/","url_meta":{"origin":32,"position":3},"title":"Actionable Data: Creating Personas from METRIC Data Analytics","date":"July 4, 2024","format":false,"excerpt":"Personas represent important segments\u00a0of a target audience or user base, making them indispensable tools in marketing, user experience (UX) design, product development, and education. Personas in marketing help create content and campaigns specifically tailored to various client bases' demands, preferences, and behaviors. They aid in making assessments about the user\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"Personas are essential tools in fields such as marketing, user experience (UX) design, product development, and education, serving to represent key segments of a target audience or user base","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/07\/Personas.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":231,"url":"https:\/\/metric.qcri.org\/blog\/2024\/06\/25\/benefits-of-metric-in-teaching-user-study-analytics\/","url_meta":{"origin":32,"position":4},"title":"Benefits of METRIC in Teaching User Study Analytics","date":"June 25, 2024","format":false,"excerpt":"Analytics Illustration [Source: ACUA] Various industries benefit from user analytic studies, both with and without knowledge. E-Commerce, logistics and transportation, hospitality, web development, real estate, healthcare, public services, and even education. Many industries need user feedback to improve their services, so implementing user analytic studies in academia benefits students. Here\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"Benefits of METRIC in Teaching User Study Analytics","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/06\/Screen-Shot-2024-06-13-at-5.59.38-PM.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":62,"url":"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/fixation-and-confusion-investigating-eye-tracking-participants-exposure-to-information-in-personas\/","url_meta":{"origin":32,"position":5},"title":"Fixation and Confusion \u2013 Investigating Eye-tracking Participants\u2019 Exposure to Information in Personas","date":"July 28, 2022","format":false,"excerpt":"To more effectively convey relevant information to end users of persona profiles, we conducted a user study consisting of 29 participants engaging with three persona layout treatments. We were interested in confusion engendered by the treatments on the participants, and conducted a within-subjects study in the actual work environment, using\u2026","rel":"","context":"In &quot;user study&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/32","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/comments?post=32"}],"version-history":[{"count":1,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/32\/revisions"}],"predecessor-version":[{"id":33,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/32\/revisions\/33"}],"wp:attachment":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/media?parent=32"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/categories?post=32"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/tags?post=32"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}