1	Orange Team Steve Filipiak Rod Hanby Barbara Okupna
2	Surprises Usability Test Results Users had much more difficulty than we expected. Feedback from the application turned out to be very poor. Help features were not helpful enough.
3	Example: Thinkature Registration Thinkature provides a dynamic form that immediately returns format or validity errors Users are unfamiliar with the feedback formats and either ignore them or are confused by the messages Technical bugs and poor feedback caused problems or most test participants.
4	Thinkature Registration
5	"Completed form fields turn green..." Completed form fields turn green when data has been entered in a valid format. Fields remain red as data is entered, and until a valid entry is attained. This seemed like a nice feature to us but was confusing users.
6	"The “verify password”" The “verify password” field was especially annoying to users because both fields turned red as the first character was entered and remained red until the content of both fields matched…or didn’t.
7	"Even though all fields appear..." Even though all fields appear valid on form submission, an inaccurate error message is displayed when a username is already in use. To add insult to injury, all form data is cleared.
8	Example: Thinkature Help Users noticed the small tool tips that displayed next to each tool, but were not looking for the instructions that displayed in the middle of the screen.
9	Recommendations Display a list of requirements for creating a user id, and fix technical problems so that the feedback is accurate. Display form error messages only when users remove focus from the text fields. Move instruction text closer to where users are looking, near the workspace tools. Redesign the icons to include the name of the tool in text. Add an option to remove the text for experienced users.
10	User Feedback Surprises Data from Post-task questions: - Some answers were really vague, but they indicated that the users noticed there was a usability issue with the application. Q: What did you feel was the most difficult part of creating the chart and any suggestions for improvement? A: P1: The tools are really bad. This was really difficult for me. P2: The tools are crude but they work. I definitely would not pay money to use this. P3: The most difficult part was getting started. Once I got the tools, it was fine. P4: Getting the dam connector arrows to stick! P5: Want an eraser tool next to the pencil. The icons of the tools are too small.
11	"Data collected by the test..." Data collected by the test moderator was really useful to determine the root of the issue. P1: Tool Function, Subject could not control the tool and became frustrated when the second box could not be connected to the first P2: Tool Function Subject initially had difficulty controlling the arrow connector tool, then paused and read the instructions in the box in the center of the screen P3: Tool Function Subject was frustrated but successful P4: Tool Function Subject could not control the tool and became frustrated when the second box could not be connected to the first P5: Tool Function She figured out how the arrow tool worked almost by accident. When she realized how the arrow tool worked she was surprised. Without data collected from observing users to perform specific tasks it could be difficult to determine usability issue.