| Dealing with Uncertainty: Understanding the Impact of Prognostic Versus Diagnostic Tasks on Trust and Reliance in Human-AI Decision-Making | Sara Salimzadeh, Gaole He, and Ujwal Gadiraju | CHI | 2024 | Trip planning | 258, Prolific, native English speakers, min. approval 95%, >= 100 completed studies. | | basePay | | amount | | perHour | 8 GBP | | perTask | - | | perParticipant | - |
| | rationales | Exceeds minimum wage |
| | bonus | | amount | | | type(s) | Performance-based | | evaluationMetric(s) | Accuracy | | mappingPolicy | 0.2 GBP per correct response | | rationales | - |
| | resultantPay | | | incentiveSchemeAsReported | On average, participants took approximately 25 minutes to complete the entire study. All participants were compensated at the fixed rate of 8 GBP per hour regardless of their performance in the study. Additionally, participants received bonus rewards amounting to 0.2 GBP for each accurate response they provided during the study period. Overall, participants earned an average of 8.44 GBP per hour, well over the wage considered to be 'good' and recommended by the Prolific platform. |
|
| How do you feel? Measuring User-Perceived Value for Rejecting Machine Decisions in Hate Speech Detection | Philippe Lammerts, Philip Lippmann, Yen-Chia Hsu, Fabio Casati, and Jie Yang | AIES | 2023 | Hate speech detection | 160 participants, Prolific (18+, fluent in English, approval rating > 90%), experience using social media | | basePay | | amount | | perHour | £9 | | perTask | - | | perParticipant | - |
| | rationales | Exceeds minimum wage |
| | bonus | | amount | | | type(s) | - | | evaluationMetric(s) | - | | mappingPolicy | - | | rationales | - |
| | resultantPay | | | incentiveSchemeAsReported | Every participant is paid an hourly wage of 9 GBP, exceeding the UK minimum wage at the time of the study. |
|