Table 2.

Task summary (mean, SD unless noted otherwise).

TaskDuration in secondsButton clicksUtterancesUser errors (error rate)aChatbot errors (error rate)b
1. Find the list of current medications.c46.1 (25.4)1 (0)0 (0)00
2. Find 2 of the side effects of Amlodipine.c69.1 (25.3)3 (1)1 (1)00
3. Add 10 mg of Lisinopril every day at noon to your medication list.d131.6 (84.1)2 (1)3 (1)1 (10%)e4 (12.9%)f
4. Update your medication reminder schedule for Amlodipine to remind you to take it on weekends at 10 am.d120.7 (52.6)4 (1)2 (1)1 (10%)g1 (4.5%)f
5. View how many refills are left and the date of your next refill for Amlodipine.c60.8 (36.1)1 (1)1 (1)00
6. Find your blood pressure values for the month of August 2020.c54.1 (20.8)3 (3)1 (1)00
7. Add a blood pressure measurement of 120/80 that was taken on September 1, 2020.d100.1 (66.8)2 (1)3 (1)06 (23.1%)f,h
8. Share your blood pressure measurements for the month of August 2020 with Dr. Smith.d69.3 (29.6)4 (1)1 (1)00
9. Schedule an appointment with Dr. Smith for Tuesday, November 17th at 1 pm.d43.8 (24.1)4 (2)1 (1)00
10. Find a healthy dinner recipe.c60.2 (28.8)2 (1)1 (1)00
Total (mean, SD)75.6 (51.5)2.5 (1.7)1.3 (1.2)2 (2.0%)a11 (8.6%)b
TaskDuration in secondsButton clicksUtterancesUser errors (error rate)aChatbot errors (error rate)b
1. Find the list of current medications.c46.1 (25.4)1 (0)0 (0)00
2. Find 2 of the side effects of Amlodipine.c69.1 (25.3)3 (1)1 (1)00
3. Add 10 mg of Lisinopril every day at noon to your medication list.d131.6 (84.1)2 (1)3 (1)1 (10%)e4 (12.9%)f
4. Update your medication reminder schedule for Amlodipine to remind you to take it on weekends at 10 am.d120.7 (52.6)4 (1)2 (1)1 (10%)g1 (4.5%)f
5. View how many refills are left and the date of your next refill for Amlodipine.c60.8 (36.1)1 (1)1 (1)00
6. Find your blood pressure values for the month of August 2020.c54.1 (20.8)3 (3)1 (1)00
7. Add a blood pressure measurement of 120/80 that was taken on September 1, 2020.d100.1 (66.8)2 (1)3 (1)06 (23.1%)f,h
8. Share your blood pressure measurements for the month of August 2020 with Dr. Smith.d69.3 (29.6)4 (1)1 (1)00
9. Schedule an appointment with Dr. Smith for Tuesday, November 17th at 1 pm.d43.8 (24.1)4 (2)1 (1)00
10. Find a healthy dinner recipe.c60.2 (28.8)2 (1)1 (1)00
Total (mean, SD)75.6 (51.5)2.5 (1.7)1.3 (1.2)2 (2.0%)a11 (8.6%)b
a

User error rate was calculated per task by: number of participants who did not successfully complete the task/total number of participants.

b

Chatbot error rate was calculated per task by: number of unrecognized utterances/total number of utterances.

c

Data retrieval task.

d

Data entry task.

e

Type of user error: did not confirm medication was added.

f

Type of unrecognized error: date/time format.

g

Type of user error: inputted incorrect medication.

h

Type of unrecognized error: blood pressure format.

Table 2.

Task summary (mean, SD unless noted otherwise).

TaskDuration in secondsButton clicksUtterancesUser errors (error rate)aChatbot errors (error rate)b
1. Find the list of current medications.c46.1 (25.4)1 (0)0 (0)00
2. Find 2 of the side effects of Amlodipine.c69.1 (25.3)3 (1)1 (1)00
3. Add 10 mg of Lisinopril every day at noon to your medication list.d131.6 (84.1)2 (1)3 (1)1 (10%)e4 (12.9%)f
4. Update your medication reminder schedule for Amlodipine to remind you to take it on weekends at 10 am.d120.7 (52.6)4 (1)2 (1)1 (10%)g1 (4.5%)f
5. View how many refills are left and the date of your next refill for Amlodipine.c60.8 (36.1)1 (1)1 (1)00
6. Find your blood pressure values for the month of August 2020.c54.1 (20.8)3 (3)1 (1)00
7. Add a blood pressure measurement of 120/80 that was taken on September 1, 2020.d100.1 (66.8)2 (1)3 (1)06 (23.1%)f,h
8. Share your blood pressure measurements for the month of August 2020 with Dr. Smith.d69.3 (29.6)4 (1)1 (1)00
9. Schedule an appointment with Dr. Smith for Tuesday, November 17th at 1 pm.d43.8 (24.1)4 (2)1 (1)00
10. Find a healthy dinner recipe.c60.2 (28.8)2 (1)1 (1)00
Total (mean, SD)75.6 (51.5)2.5 (1.7)1.3 (1.2)2 (2.0%)a11 (8.6%)b
TaskDuration in secondsButton clicksUtterancesUser errors (error rate)aChatbot errors (error rate)b
1. Find the list of current medications.c46.1 (25.4)1 (0)0 (0)00
2. Find 2 of the side effects of Amlodipine.c69.1 (25.3)3 (1)1 (1)00
3. Add 10 mg of Lisinopril every day at noon to your medication list.d131.6 (84.1)2 (1)3 (1)1 (10%)e4 (12.9%)f
4. Update your medication reminder schedule for Amlodipine to remind you to take it on weekends at 10 am.d120.7 (52.6)4 (1)2 (1)1 (10%)g1 (4.5%)f
5. View how many refills are left and the date of your next refill for Amlodipine.c60.8 (36.1)1 (1)1 (1)00
6. Find your blood pressure values for the month of August 2020.c54.1 (20.8)3 (3)1 (1)00
7. Add a blood pressure measurement of 120/80 that was taken on September 1, 2020.d100.1 (66.8)2 (1)3 (1)06 (23.1%)f,h
8. Share your blood pressure measurements for the month of August 2020 with Dr. Smith.d69.3 (29.6)4 (1)1 (1)00
9. Schedule an appointment with Dr. Smith for Tuesday, November 17th at 1 pm.d43.8 (24.1)4 (2)1 (1)00
10. Find a healthy dinner recipe.c60.2 (28.8)2 (1)1 (1)00
Total (mean, SD)75.6 (51.5)2.5 (1.7)1.3 (1.2)2 (2.0%)a11 (8.6%)b
a

User error rate was calculated per task by: number of participants who did not successfully complete the task/total number of participants.

b

Chatbot error rate was calculated per task by: number of unrecognized utterances/total number of utterances.

c

Data retrieval task.

d

Data entry task.

e

Type of user error: did not confirm medication was added.

f

Type of unrecognized error: date/time format.

g

Type of user error: inputted incorrect medication.

h

Type of unrecognized error: blood pressure format.

Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close