{"id":34,"date":"2022-07-28T09:04:03","date_gmt":"2022-07-28T09:04:03","guid":{"rendered":"https:\/\/metric.qcri.org\/blog\/?p=34"},"modified":"2022-07-28T09:04:04","modified_gmt":"2022-07-28T09:04:04","slug":"suggestions-for-online-user-studies","status":"publish","type":"post","link":"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/suggestions-for-online-user-studies\/","title":{"rendered":"Suggestions for Online User Studies"},"content":{"rendered":"\n<p>During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases.<\/p>\n\n\n\n<p>We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork).<\/p>\n\n\n\n<p>Our recommendations aim to help those inexperienced with online user studies. They are also beneficial for those interested in increasing their proficiency, employing this increasingly important research methodology for studying people\u2019s interactions with technology and information.<\/p>\n\n\n\n<p>Salminen J., Jung S., and\u00a0Jansen B.J.\u00a0(2021)\u00a0<a rel=\"noreferrer noopener\" href=\"http:\/\/www.bernardjjansen.com\/uploads\/2\/4\/1\/8\/24188166\/salminen2021_chapter_suggestionsforonlineuserstudie.pdf\" target=\"_blank\">Suggestions for Online User Studies<\/a>. In: Stephanidis C. et al. (eds) HCI International 2021 &#8211; Late Breaking Papers: Design and User Experience. HCII 2021. Lecture Notes in Computer Science, vol. 13094. pp 127-146.\u00a0<a href=\"https:\/\/doi.org\/10.1007\/978-3-030-90238-4_11\">https:\/\/doi.org\/10.1007\/978-3-030-90238-4_11<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>During exceptional times when researchers do not have physical access to users of technology, the importance of remote user studies increases. We provide recommendations based on lessons learned from conducting online user studies utilizing four online research platforms (Appen, MTurk, Prolific, and Upwork). Our recommendations aim to help those inexperienced with online user studies. They &#8230; <a title=\"Suggestions for Online User Studies\" class=\"read-more\" href=\"https:\/\/metric.qcri.org\/blog\/2022\/07\/28\/suggestions-for-online-user-studies\/\" aria-label=\"More on Suggestions for Online User Studies\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-34","post","type-post","status-publish","format-standard","hentry","category-user-study"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":168,"url":"https:\/\/metric.qcri.org\/blog\/2024\/03\/14\/some-insights-and-recommendations-about-user-studies\/","url_meta":{"origin":34,"position":0},"title":"Some insights and recommendations about user studies","date":"March 14, 2024","format":false,"excerpt":"We have published a series of research articles examining user studies, including implementation suggestions. Some insights and recommendations about user studies Some of our findings and recommendations are: Fair pay: Paying crowdworkers adequately is task dependent Real Users: Students are overused in academic studies; there are workable alternates to get\u2026","rel":"","context":"Similar post","img":{"alt_text":"Some insights and recommendations about user studies","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/03\/insights_into_user_studies_jansen.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":75,"url":"https:\/\/metric.qcri.org\/blog\/2022\/09\/30\/who-is-in-the-sample-an-analysis-of-real-and-surrogate-users-as-participants-in-user-study-research-in-the-information-technology-fields\/","url_meta":{"origin":34,"position":1},"title":"Who is in the sample? An analysis of real and surrogate users as participants in user study research in the information technology fields","date":"September 30, 2022","format":false,"excerpt":"This research aims to determine how often user studies reported in peer-reviewed information technology literature sample real users or surrogate users as participants. Constructing a sample of real users as participants in user studies is considered by most researchers to be vital for the validity, usefulness, and applicability of research\u2026","rel":"","context":"In &quot;user study&quot;","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":231,"url":"https:\/\/metric.qcri.org\/blog\/2024\/06\/25\/benefits-of-metric-in-teaching-user-study-analytics\/","url_meta":{"origin":34,"position":2},"title":"Benefits of METRIC in Teaching User Study Analytics","date":"June 25, 2024","format":false,"excerpt":"Analytics Illustration [Source: ACUA] Various industries benefit from user analytic studies, both with and without knowledge. E-Commerce, logistics and transportation, hospitality, web development, real estate, healthcare, public services, and even education. Many industries need user feedback to improve their services, so implementing user analytic studies in academia benefits students. Here\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"Benefits of METRIC in Teaching User Study Analytics","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/06\/Screen-Shot-2024-06-13-at-5.59.38-PM.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":274,"url":"https:\/\/metric.qcri.org\/blog\/2024\/07\/01\/are-you-looking-to-improve-your-research-and-teaching-methods-metric-can-help-you-and-your-students-engage-with-user-studies-at-scale\/","url_meta":{"origin":34,"position":3},"title":"Are you looking to improve your research and teaching methods? METRIC can help you and your students engage with user studies at scale.","date":"July 1, 2024","format":false,"excerpt":"Attention Human-Computer Interaction (HCI) Educators and Researchers! Are you looking to improve your research and teaching methods? METRIC can help you and your students engage with user studies at scale.Are you looking to improve your research and teaching methods? METRIC can help you and your students engage with user studies\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/07\/METRIC_Teaching_July_2024.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":287,"url":"https:\/\/metric.qcri.org\/blog\/2024\/07\/05\/eye-tracking-beyond-conventional-uses\/","url_meta":{"origin":34,"position":4},"title":"Eye Tracking Beyond Conventional Uses","date":"July 5, 2024","format":false,"excerpt":"Eye tracking is a versatile technology with applications across various fields for its ability to provide detailed insights into visual attention and behavior. With more and more organizations gaining interest in this technology\u2019s abilities, there has been a rise in numerous offline and online eye-tracking tools such as METRIC. User\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"eye-tracking technology for early screening and diagnosis of ASD","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2024\/07\/openart-image_notBvuei_1720099256913_raw.png?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":129,"url":"https:\/\/metric.qcri.org\/blog\/2023\/08\/21\/do-you-need-real-users-in-user-studies-user-experiments-and-user-surveys\/","url_meta":{"origin":34,"position":5},"title":"Do you need real users in user studies, user experiments, and user surveys?","date":"August 21, 2023","format":false,"excerpt":"Do you need real users in user studies, user experiments, and user surveys? When you design user studies, user experiments, and user surveys (a.k.a. user research), there is a need to sample from the user population \u2013 that is selecting real users. Selecting real users is often considered vital for\u2026","rel":"","context":"In &quot;analytics&quot;","img":{"alt_text":"","src":"https:\/\/i0.wp.com\/metric.qcri.org\/blog\/wp-content\/uploads\/2023\/08\/real_users.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/34","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/comments?post=34"}],"version-history":[{"count":1,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/34\/revisions"}],"predecessor-version":[{"id":35,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/posts\/34\/revisions\/35"}],"wp:attachment":[{"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/media?parent=34"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/categories?post=34"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/metric.qcri.org\/blog\/wp-json\/wp\/v2\/tags?post=34"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}