Transcript for:
Usability Research in UX Design

you know all about the first step in a ux research study which is planning the study it's time to move to the second step which is really exciting conducting the research so let's get started a usability study is a research method that assesses how easy it is for participants to complete core tasks in a design during a usability study researchers follow participants as they interact with a product the user's feedback helps the design team make important improvements to the user experience usability studies can take place at various points in the design process you can conduct a usability study when you have an early idea like a low-fi prototype that is only somewhat interactive often this is called concept testing you can also conduct a usability study when you have an interactive prototype this is the most common time to conduct a study because it gives the design team insight on what needs to be revised or added before the product launches you can even conduct a usability study with a product that is complete you may want to change a feature of the product or test if the product is usable with a specific group of people imagine this scenario a local bakery has a website but customers can't place their orders online the bakery has asked you to create a new feature that will allow customers to order on their website you've created a prototype of the website that includes this new feature to place an online order you decide to conduct a usability study to understand how easy it is for users to complete an order as part of the study participants navigate the prototype from the landing page to checkout acting as if they're real customers as a researcher you collect feedback as you watch the users interact with a prototype in some usability studies you can even interview participants after they're done interacting with the prototype in order to get more feedback you might be wondering how much feedback about my design should i get we recommend recruiting a handful of participants for a usability study for our examples we'll have five participants in the usability study this sample size is large enough to uncover major user issues but small enough to keep the cost down let's focus on one of our usability study participants alex as part of the study alex tries to order a birthday cake for their son on the prototype of the bakery's website by following alex through the ordering process you discover that alex's user journey hits a problem first the birthday cake that alex wants to order for their son is pretty specific they want a rectangular rainbow cake topped with rainbow sprinkles and a unicorn placed in each of the four corners of the cake alex selects a rectangular rainbow cake without any trouble and alex adds the rainbow sprinkles by selecting them from a drop down menu labeled decorations alex notices that unicorns are also on the decorations list so they are selected easily but then alex hits a problem and veers off the happy user path when alex adds the unicorn decoration there's no quantity option so alex can't order four unicorns there's also not a section for notes so alex is not able to specify that the unicorn should be placed in each corner of the cake to add to alex's frustrations the prototype site does not include a help button during the usability study alex is open and honest about these problems thanks to alex's feedback the design team can now work out solutions to improve the bakery's website keep in mind usability studies give ux designers a way to test their designs and get feedback without much risk and a lot of reward while the user feedback might not all be positive it will always always make the product better coming up we'll get to know the two types of usability studies moderated and unmoderated let's go now that we know the basics of usability studies we'll get into some specifics there are two types of usability studies moderated and unmoderated let's check them out in moderated usability studies a person guides participants through the study in real time the person who guides participants through the study is known as the moderator the moderator's goal is to help participants interact with the product and collect their feedback along the way on the other hand unmoderated usability studies do not have a designated moderator in unmoderated usability studies participants test out the prototypes without human guidance usually the study is recorded on video and the ux team reviews the video footage after the study moderated and unmoderated usability studies have benefits and limitations depending on the scope and goals of your study to compare these two types let's walk through the benefits and limitations for each in detail we'll start with some of the benefits of moderated usability studies first in moderated usability studies the moderator guides the participant through the study for example the moderator might show the participant where to click and ask them about their experience when taking that action this is beneficial because participants take the exact actions you want to get feedback about second moderated studies allow the moderator to ask specific questions and follow up in real time to learn more similarly the moderator can rephrase a question that a participant is not understanding this is beneficial because it allows you to collect more information that you can act on to improve your design third moderated usability studies allow for rapport building between the moderator and participant which can help the participant open up and share more feedback about the design building rapport is especially important if the design being tested deals with sensitive or personal issues okay so moderated usability studies sound pretty great right well they also have some limitations the moderator could influence or bias the participants because a person is guiding the study there's a chance that person can accidentally let their own thoughts or feelings come into the study also moderated usability studies are less flexible it's harder to reach populations like single parents or night shift workers who may be unavailable during the daytime hours the study can also be difficult to reschedule if a participant does not show up in addition there's a chance that the participant may not identify with a moderator this could make the participant less comfortable and less open with their feedback there are many more benefits and limitations to moderated usability studies which you can learn about in the upcoming reading all right let's shift gears and think about unmoderated usability studies remember unmoderated studies did not have a person guiding the participants let's discuss the benefits of this type of study first it's easier to see how a participant uses the product in the real world in unmoderated usability studies you give the participant a list of tasks to complete on their own this helps you see how the participant would experience your product without a moderator guiding each step second unmoderated usability studies allow participants to complete tasks on their own time and in their own space because there is no need for a moderator this also makes it easier to schedule unmoderated studies third depending on the subject matter especially if it's sensitive participants may feel more comfortable giving feedback without others around as you might have guessed there are also limitations to unmoderated usability studies in an unmoderated usability study participants have no human guidance participants get a list of fixed questions and tasks but if they have issues or need technical assistance there's often no one to help them next unmoderated usability studies don't give the ux team an opportunity to ask the participant real-time follow-up questions this can be limiting if the participant does not explain their problem in detail because there's no way to follow up once the ux team watches the recording lastly there is little to no control over the environment to ensure you have the participants full attention without a moderator present participants could multitask and not be focused on the key activities in the study ultimately to decide which type of usability study to conduct the ux team has to consider the scope and goals of the study and the types of participants you are trying to reach next up we'll talk about how usability studies are structured now that you know the basics of usability studies it's time to watch one in action you learned that usability studies can be moderated or unmoderated join me as i conduct an unmoderated usability study so you can get a feel for how this works in the real world let's continue to imagine that we are on a ux team that is creating an app to help people find and schedule dog walkers the design team wants to learn how easy it is for users to go through the main user experience of finding and scheduling dog walkers in the app to figure this out i've been asked to lead an unmoderated usability study for the dog walking app i'll have participants test our low fidelity prototype i've recruited five participants to provide feedback from the comfort of their own homes i'll need your help to watch the recordings of the five participants as a researcher your goal is to pay attention to how each user responds to the tasks they are asked to perform as you watch each video you'll see the participants try to complete a series of tasks that the design team wants to get feedback on the participants will also share what they are thinking as they try to complete the tasks since this is your first usability study just get a feel for how the process works as you watch each participant for future studies you'll take notes during the study but let's keep it simple for now it looks like the recordings for each participant just got uploaded let's get started with our first one hi there i'm jordan hill i'm going to be completing this usability study on labels parts of the gmail product this is my first time i've ever done a study like this so let's pull up the prompts and see what i need to do here prompt one if i said let's set up gmail labels for your email inbox what do you think you might use this for all right labels for my inbox well my inbox isn't the most organized to be honest i guess i'd label some of the emails under certain categories like finance work or kids but i don't really know if i see how helpful this would be my inbox is so full of emails i'm not sure how this would make it more organized prompt 2 let's open gmail in a web browser on the desktop computer now try to create a new label called shopping how would you go about doing that okay open up gmail got it create a new label okay ugh this is honestly super confusing i don't even know where this would be okay honestly i'm going to give up and google it this is so confusing prompt 2 follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging yeah this was super challenging i basically needed to google how to find it it's confusing to me why gmail has this feature and then hides it not a fan now that i'm able to find this feature i can see how you might use labels sort of like a folder maybe they should rename it folders prompty let's say you now wanted to change the color of the shopping label to your favorite color how would you do that got it okay try to change a color let's try clicking on this thing okay this is confusing because i just clicked on the color of the label but it just goes to the emails there isn't any way to change the label's color let me go back let's try these little dots ah yes cool well that wasn't exactly obvious but i can see here this is where you would go to change the color prompt 3 follow-up was this particular feature functionality useful why or why not what was easy and what was challenging this was just pretty challenging all together normally you'd think to change the color right where you'd click it on it instead i had to hover and find these secret dots not ideal but i'd eventually find it prop 4 finally try to make a sub label named receipts receipts in a sub label let's try those three dots again those seemed useful even though they're basically hidden this is confusing i don't see anything here about sub labels uh has to be here somewhere this is super annoying honestly i'm just gonna skip this one sorry prompt4 follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging i eventually figured it out but i don't really understand why you'd use a sub-label or what i'd really want it for i also don't know if nesting and sub-label mean the same thing prop 5 how do you think you'd improve setting up of a label absolutely i think creating new labels should be in front and center and i also think changing the color would work a lot better if you could just click on the actual colored area next to the label okay so wow this is definitely not an intuitive situation i don't understand why gmail hides the label feature i mean honestly it's pretty much buried under settings i don't think you can even see it but i think that's it i've gotten through these tasks so that's it signing off hello i'm alex i'm going to be completing this usability study on the labels part of the gmail product i've never used labels before but i love being organized i'm excited to see if i can use this feature so let's pull up the prompts and see what i need to do here if i said let's set up gmail labels for your email inbox what do you think you might even use this feature for let's see i'd imagine this is some kind of folder i could use to label categories in my email i'm not entirely sure how that helps overall but i'm definitely interested in it if it does work like a folder system i can imagine it would be a great way to archive old emails so let's open gmail in a web browser on a desktop computer now try to create a new label called shopping how would you go about doing that honestly i have no idea how many guests labels are in the settings area somewhere all right let's take a look okay so here we are in gmail labels labels labels labels uh gear icon that's always promising settings that's good density theme maybe see all settings well this is weird this is definitely settings i'm not sure where it would be there's categories here but nothing about labels let me try this help button oh great a search box let me go ahead and search for labels create labels how do i create labels in gmail create labels to organize gmail there we go that's what i want let me just read this really quickly create a label on the left oh there we go look at this scroll down and then click more okay more where is that here it is all right well let's click on more all the way at the bottom of more hey check that out create a new label i see it now and now let's create a new label if you remember our label is going to be shopping oh i see it's way down hidden on the left okay great got it done there it is was this a particular feature or functionality useful why or why not what was easy what was challenging well honestly my biggest problem was just getting started i had no idea where to start i already knew the gear icon was a settings icon inside of gmail so it was confusing that the labels weren't there now that i've got the label created i can honestly see why they put it in the main inbox left window pane it's a lot more accessible there with the other labels let's say you now want to change the color of the shopping label to your favorite color how would you do that okay uh change the color hmm let's start click on shopping let's go back down to managing labels oh wow yeah well this doesn't seem to be it either well nothing about colors anyway well i'm just gonna google it honestly that's often worked for me in the past let's try it so let's go to google.com and let's look at change the color of a gmail label let's change it to red so let's go ahead and search that ah i see there's three hidden dots in a drop down menu well let's go back into gmail find our shopping label where'd you go look at that three little dots as i hover over slowly click on that and let's change the label color to red so i never miss an email the label for shopping was adjusted nice was this particular feature or functionality useful why or why not what was easy and most challenging well changing the colors would definitely be useful and a great way to stay organized i'm a very visual person but i can't imagine having found that hidden drop down menu without first searching on the web okay finally try making a sub label named receipts okay now that i know where the colors area is i can see this thing called sub labels this doesn't seem too difficult let's go ahead and add a sub label called receipts and look at this nest the label under shopping perfect click create look at that now i have a label for shopping and a label for receipts nice well was this particular feature or functionality useful why why not what was easy and what was challenging absolutely this would be useful i definitely see myself using sub labels quite a bit actually like for the family we have all these different areas to organize doctor's appointments school meetings i could see using it for that and it really wasn't hard at all to get set up since i did the other tasks first how do you think you'd improve the setting up of a label well if gmail wants people to use labels i'd recommend making it more prominent where to start i had no idea and it took me a long time to figure that out they can move up the create label area so people can see it without digging first other than that i think the rest of it makes a lot of sense okay sweet it looks like i've completed the tasks thank you hi i'm chris i'm going to be completing this usability study on the labels part of the gmail product so the first prompt says if i said let's set up gmail labels for your email inbox what do you think you might use this feature for i could see myself labeling some emails so i can find them again probably mostly i'd want to label things vip and respond so i remember to get back to people so prompt number two says let's open gmail in a web browser on a desktop computer now try to create a new label called shopping how would you go about doing that since gmail organizes folders on the left i'm gonna take a guess somewhere down here is the label spot yep it's right here okay i'm adding this label and calling it shopping okay so the prompt says was this particular feature or functionality useful why or why not what was easy and what was challenging definitely not challenging i think i've used these in the past maybe it was it was pretty intuitive to find the label area and make a new one so prompt three says let's say you now wanted to change the color of the shopping label to your favorite color how would you do that well i did see some sort of label settings next to creating a new label so let's give that a try this isn't very clear i'm having trouble finding what i'm looking for oh what about this these three dots look like a submenu got it great now it's blue so the prompt three says was this particular feature or functionality useful why or why not what was easy and what was challenging i'm definitely a big fan of color coding so i could see this as being useful i actually organized my bookshelf by color so it's cool to use this in email too these three dots are pretty hard to find but i've used email products like this before so it made sense to me where it might be so the next prompt says finally try making a sub label named receipt sub label okay hmm well that clearly isn't right this is for editing the label name let me go back to that menu of options oh now i see it add sublabel okay so prompt number four was this particular feature or functionality useful why or why not what was easy and what was challenging it was a little hard to find the sub-label area but i could definitely imagine using this i have a lot of little categories like receipts that actually that might be nice to organize under bigger areas so yes this could definitely work okay prop number five how do you think you'd improve the setting up of a label overall i think the product should highlight labels more prominently i'd also love some of the settings to all be in one place instead of so many different windows well i think that covers it bye hey i'm sage i'm going to be doing this usability study on the labels feature of the gmail product i'm not sure what to expect but let's see what happens prompt one let's set up a gmail labels for your email inbox what do you think you might use this feature for well if you get a lot of emails every day maybe labels can help you organize everything in a better way i mean to put everything in different categories prompt two let's open gmail in a web browser on a desktop computer now try to create a new label called shopping how would you go about doing that yeah so i open up my gmail and then i look for it okay i guess this is the right place i'm creating the label now prompt two follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging yeah i think this was easy to do after a little experimenting prompt three let's say you now wanted to change the color of the shopping label to your favorite color how would you do that this works pretty easily and there are not too many steps let's try this maybe changing the settings or going to the help menu uh yeah this task seems easier to do yes it seems not clear how to make the labels but if you play with the mouse in that area you can figure it out prompt three follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging for me this idea is okay but what about colorblind people did google think about that it's not practical for everybody prompt for finally try making a nested label named receipts i can try making a sub label now that i know about the labels feature this should be easy prompt for follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging these features work well i guess and they keep you organized i'm good with gmail so i don't have too many problems prompt five how do you think you'd improve the setting up of a label maybe a little video to explain a lot of people will ask how a label is different from a folder and i still don't understand why i should use labels i think i finished everything i'm supposed to do cool bye hi everybody i'm taylor i'm joining a usability study about creating labels in gmail so excited to get started and i'm sure that i'll learn a lot of useful information okay let's start the prompts and see how this labels feature works prompt one let's set up gmail labels for your email inbox what do you think you might use this feature for i work in marketing and i have people who work above me that i'm emailing every day and i have a long list of clients so definitely something like this would help maybe one list for the clients one for my team and if i like labels for promotions about new products i have two work gmail accounts and one personal gmail account so i wonder if labels is a feature that's for professional or personal use but maybe when i try out the feature more i can understand what it's going to be used for right prompt 2 let's open gmail in a web browser on a desktop computer now try to create a new label called shopping how would you go about doing that i would open up my gmail again then scroll down and click more is that the right way labels would have to be one of the options after that right this part is not easy okay there it is i see create new label on the left side so far so good i always panic a little when i have to use new features in gmail i actually used another email client for the last 15 years i used it at my job in construction management did i tell you about that so i'm really super used to that old system and i only started using gmail about two months ago so you might say that changing to new systems and learning new features can definitely make me feel a little bit stressed prop 2 follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging this was really useful but i'm not sure how you would make the appearance of the labels different i mean if you have only a few labels it's not important but if you have many labels and they all look the same it's not efficient google should think about adding more options to change the appearance like fun colors or fun animation prompt three let's say you now wanted to change the color of the shopping label to your favorite color how would you do that yes manage labels seems like the best place to start if i want to edit any of the details of my labels let's see if it works let's try this out okay the steps seem pretty straightforward yes this seems pretty easy to follow but how do i choose the color that part is not clear at all okay got it now this is the fun part my favorite color is red so i'll choose red but then again red is not such a professional color let's make it blue my job can be pretty stressful so i need a relaxing color for sure prompt 3 follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging colors are such a good idea for making categories for the labels and to make them easy to find but one of my gmail accounts has a black background so if i add in different label colors that might be hard to see maybe google should design an app that we can use to customize the colors of our gmail folders and labels prop 4 finally try making a nested label named receipts let's see if this task is easier than the last one i hope it is ok scrolling down from show to hide to edit to remove label to add sub label that's it okay this word nest just threw me off i'm always afraid that i'll check some feature that i want and then not be able to change it later maybe if there was a little question mark icon next to the word nest it would help prop 4 follow-up was this particular feature or functionality useful why or why not what was easy and what was challenging this feature was easy to navigate but i don't think it will be very helpful for me to create all these sub-labels it could be extra work instead i would probably just make labels and forget about that sublabels part prop 5 how do you think you'd improve the setting up of a label google could create an instructional video that explains all of these steps it seems like all of these steps would be easy but when you open your gmail account and see all these options and folders in front of you it can get a little confusing already there are so many buttons you see in different places to access features when you go into gmail and all this really adds to the stress of how to find what you're looking for but overall the experience was positive and i'll consider ways to use labels for my work gmail accounts in the future i guess i finished everything awesome thank you for the opportunity okay thanks how was watching your first unmoderated usability study hopefully you now have a feel for how an unmoderated usability study is conducted in the real world pretty cool right as we discussed earlier there are two types of usability studies moderated and unmoderated we're going to shift our focus to moderated usability studies now in this video you'll learn how to moderate a usability study yourself we'll start from the beginning of the study and focus on how to connect with participants before the study actually begins ready to get started first it's really important to build a rapport with participants ask general questions about how they're doing or what their day has been like doing this before the study starts can go a long way to make the participant feel comfortable you want to establish a professional but friendly rapport with the participants right from the start second thank participants for coming don't skip over this step make sure participants know how grateful you are that they're taking the time to participate in the study even after the study is conducted it's important to show how grateful you are for their participation you can do this by sending them off with a small thank you gift it's also helpful to remind participants that their feedback on the product has the potential to help millions of users it's important to be open and honest about their experience so the design team can make improvements if a participant is worried about offending the design team you won't get the useful feedback you're after emphasize that nothing they say will offend you or hurt your feelings and that any issues that they have navigating your design will probably come up for many other participants too let the participant know that you're here to find out how to improve the design so constructive criticism is more than welcome next it's time to have participants fill out paperwork you'll likely have participants complete a non-disclosure agreement or nda which we've discussed earlier this might sound intimidating but your job as the study moderator is to frame this in a casual and approachable way since the designs they'll provide feedback on might not have launched yet you want to ensure participants don't share any details about the designs with the outside world but it's not all about us if the nda is set up correctly it helps build trust with participants and increase rapport this is especially important with participants from historically marginalized communities or at-risk populations who have often been taken advantage of in research once the ndas are signed explain the focus of the study and what participants will give feedback on give the participant a roadmap or a preview of what's to come it's always a good idea to let them know what to expect and then to ask does this sound good make it a practice to check in with the participant to make sure they're comfortable with what you've planned now it's time to establish the ground rules for the study for example you might want participants to use the think aloud method meaning you want them to explain what's on their mind while they're doing it this is the time to let participants know what you'd like them to do and give them specific examples of how for instance a think aloud might work also remind participants that they are not being tested there are no right or wrong answers to any of the questions you ask if the participant can't complete a task that isn't a reflection of their personal abilities it's a reflection of the design's usability you want this to be a low pressure experience no participant should leave a study feeling like they failed somehow the goal is to understand how the user is experiencing your product so there's no right or wrong answer there's one more thing to keep in mind when moderating a usability study keep your emotions neutral your mood should not impact your judgment or influence your participants feedback make time to reflect on your emotional state before the usability study begins this helps you separate your emotions from what goes on during the study and if you have a hard time keeping your emotions neutral during the study for some reason this reflection can help you identify where your emotions might have influenced your research and that's it you now know how to get started at the beginning of a moderated usability study you may be noticing a theme in ux design you want to keep the user front and center in all of your work and in ux research you want to keep the participant front and center each step of the way the best practices we just shared are all about the participant and their experience during the usability study up next we'll move into how to effectively communicate with participants during the actual usability tasks let's keep going you're doing a great job learning about moderating a usability study you've set the stage at the beginning of the study to make your participants feel comfortable and confident now let's focus on how to effectively communicate with participants during the usability tasks when you're the moderator of a usability study your main goal is to pay attention to and understand your participants to conduct a successful moderated usability study you need to know what kinds of questions to ask participants and how to ask them so let's go through a few techniques for moderation during the usability study itself the first technique for moderation is to ask open-ended questions open-ended questions are questions that cannot be answered with a simple yes or no response this gives participants more opportunities to provide feedback for example after participants complete a task in the usability study ask how do you think that went instead of did you like it as you interview participants there might be times when you have trouble understanding their feedback or you may not be sure if you're correctly interpreting what the participant is saying that's totally fine all you need to do is ask some follow-up questions so the participant can clarify what they mean this is our second technique for moderating a usability study ask follow-up questions ask questions like tell me more about that or can you expand on that these questions will help you avoid making assumptions about what the participant might have meant if you're still unsure what the participant's feedback means try to summarize their answer for confirmation repeat back what you think the participant means and allow them to correct or confirm the statement be careful not to summarize their feedback for confirmation right away or you'll run the risk of leading the participant to a certain answer always ask the participant open-ended and follow-up questions first then use this technique if you're still unclear alright now you know a few techniques for moderation during the usability study itself making progress as you're moderating usability study keep in mind that you'll have a diverse group of participants as a researcher you come into the study with biases you need to be aware of next up we'll learn about biases that are likely to come up when you're moderating usability studies you might remember when we discussed biases in ux research in an earlier course in this video we'll focus on biases that might occur when you moderate usability studies remember a bias is favoring or having prejudice based on limited information it's important to call out that all humans are susceptible to bias yes even you and me the key is to identify and become aware of these biases so that you can guard against them identifying your own personal biases can be challenging because bias is usually unconscious a lot of times we don't even realize we're experiencing it but if you know what biases you have you can take steps to minimize their effects let's go over some common biases you or your participants might have during usability studies let's start by discussing a couple of biases that you might have as a moderator during a usability study the first bias is one we've already discussed implicit bias or unconscious bias remember implicit bias is the collection of attitudes and stereotypes we associate to people without our conscious knowledge these attitudes and stereotypes are often negative exclusionary or disempowering when recruiting participants for usability studies any implicit biases you have against a particular user group might impact your expectations for how those participants will interact with the product another bias you might have as a moderator during a usability study is serial position effect which we've discussed in a previous video serial position effect is a psychological bias that states that when given a list of items people are more likely to remember the first few and the last few while the items in the middle tend to blur be aware that when you're interviewing participants the first and last things they reveal might stand out to you more than the feedback in the middle because of the serial position effect similarly your participants might experience the serial position effect if you give participants a list of instructions they're more likely to remember the first and last items on the list next up another bias often experienced by participants friendliness bias friendliness bias describes the tendency of people to agree with those they like in order to maintain a non-confrontational conversation think about this in the real world has your friend ever asked you if you want to eat at their favorite restaurant even if you hate the food you might agree to go to their favorite restaurant in order to avoid confrontation while this might have benefits in the social world in the world of usability studies it can present a bit of an obstacle as a moderator if you are too friendly and develop too strong a rapport with participants there's a chance participants will want to agree with you in order to avoid confrontation this can stop participants from giving honest feedback your goal is to improve the product's design so remind participants that you actually need honest feedback in order to improve the product the last bias moderators need to guard against is the social desirability bias which describes the tendency for people to answer questions in a way that will be viewed favorably by others you've probably seen this happen in your own life imagine you're with a group of friends who are talking about a movie they enjoyed one of them asks you did you like the movie and everyone turns to see your response you're likely to say yes i loved it to be viewed favorably by the group even if you didn't actually love it similarly in usability studies the social desirability bias can cause participants to focus on the positive aspects of their experience with the product and minimize the negative aspects one way to guard against this bias is to provide participants with a series of statements that came from other users ask participants which statement they must relate to and emphasize that there's no correct answer okay you're becoming a pro when it comes to usability studies you now know the bias to watch out for when you're conducting a usability study and interacting with participants coming up we'll continue this conversation and share some strategies for reducing your own bias during usability studies you now know a few common types of bias that can come into play during usability studies keep in mind that being aware of biases like these is actually the first step in reducing them so we're already on our way in this video we'll explore strategies for reducing your own bias when conducting usability studies the first thing you can do to overcome bias is to identify and admit your own biases as part of our work ux designers make a lot of assumptions but we also test them out and revise them when we get new information by acknowledging your own biases you can be more objective and question your assumptions as you conduct a usability study for example imagine you're designing a website that sells handbags before we design the website let's start with a little introspection or soul searching make sure you have a piece of paper and a pen ready pause the video if you need to grab supplies think about handbags and answer the following questions we'll give you 10 seconds to write down ideas for each one who uses handbags how are handbags used what other thoughts do you have when you think about the word handbags let's review what you've written down when asked the questions who uses handbags did you list a certain group of people like women did you consider that men might also carry handbags if you primarily thought about handbags being used by women you may have a bias that men are not interested in handbags in some cultures it's common for men to use handbags every day and when asked the question how are handbags used did you list to carry lipstick keys or a wallet based on what you listed you may have a bias that handbags are used to carry certain items sometimes handbags are used to carry dogs or your lunch learning about all of your biases will take a lot of work and reflection it might even be hard and uncomfortable this exercise is just one simple example to get you thinking about what your biases might be being aware of your own biases can help you avoid forming any opinions before you have results from your research when conducting usability studies be sure to phrase questions in a way that allows for a diversity of responses the next thing you can do to reduce bias when conducting usability studies is to find participants from a representative sample the small group of participants you conduct your usability study with should represent your key user group as well as user groups that are often marginalized next define the research criteria beforehand remember when you created a plan for usability study a couple of the key elements focused on the research goals and research questions by establishing research goals with your team before the usability study begins you reduce the chance of designer biases leading you down the wrong path also phrase interview questions thoughtfully if we ask a participant do you like the design experience we might not get all the information we need stick to open-ended non-leading questions like how did it go what was your experience like or what worked and what didn't work for you and why remember the goal of usability studies is to get honest feedback from the participants next let participants express themselves fully and in their own words during the usability study make sure you understand exactly how participants feel and why as we discussed earlier if you need more clarity on what a participant says ask a follow-up question finally be mindful of your body language remember the friendliness bias a lot of us are people pleasers if you react favorably to something when you are the moderator by nodding or smiling this might encourage participants to share feedback that will get them more nods or smiles body language like this can bias the feedback that participants provide identifying your own biases and how your actions can bias participants is a long process that takes a lot of practice you've learned some of the most common biases in ux research and effective strategies for combating bias so you're already off to a great start coming up we'll learn how to take notes during a usability study now that you know how to conduct your study and avoid biases in the process it's time to think about another important part of usability study note taking in this video we'll explore why you need to take notes during a usability study and who takes notes and ways to take effective notes you might be wondering why we take notes during a usability study especially if the session is being recorded well there are a lot of reasons first note-taking lets you capture any thoughts you have during the usability study for example you can indicate what you notice about each participant's body language or the way that they're talking are they smiling do they seem frustrated these are all useful observations to put into your notes remember to keep what we just learned about biases in mind whenever you make assumptions on how a participant is feeling based on body language or tone of voice one way to avoid this bias in a moderated study is to ask the participant how they felt at the point in the study where they appeared to show an emotion think back to the mock usability study from earlier when conducting a usability study live or watching the recordings you can take notes on the tone of the participant's voice or even their word choice when describing the tasks let's review how participant a completed a task in the example usability study prompt three confirm booking of dog walker and complete the checkout process got it okay i'm going to click book right here this seems fairly simple what the heck it looks like this is a page with details about my booking and the total cost the app didn't even give me a page to confirm the dog walker i selected or the date and time i need i'm not even sure if i had all the right details but it went right to confirming the appointment that's so annoying i feel like most apps let you review what you're booking before you actually finish paying now let's review how participant d completed the same task prompt three confirm booking a dog walker and complete the checkout process is booking the same thing as completing the checkout process is there a cart or something let me go back maybe i missed an add to cart button i'd expect to see an add to cart or something here i'm not sure on this one okay let me go to the learn more page that was on earlier this must be somewhere okay so it looks like i'm back here again my only option seems to be click on the book button so i'll try it oh wow seems like that worked although i really don't know what happened the screen says congrats and total cost but i don't really know what i booked or clicked like there was no confirmation page to tell me about the dog walker the time or price i was scheduling how strange i don't think i ever had this happen before what do you notice about the word choice these participants used did you catch that their words made it sound like the task was not easy if you can hear their voices you may have noticed that their tones were very different from one another participant a sounded frustrated but participant d spoke in a positive tone even when they found the task difficult they still remained upbeat this is why note-taking is so important during usability studies it helps you capture thoughts that the participants may or may not verbalize second you might take notes to summarize a participant's experience during the study let's review how participant c felt about the whole experience from five would you use the dog walking app yeah i definitely use this for short it really seems super simple to use i just love to see a little more customization and of course some more actual details of the content after that i think it's pretty much ready to go thanks for letting me try it out today for example you may write participant c felt the app was simple to use and would love to see more customization third your notes can highlight really compelling quotes to include in your research report let's review how participant d completed a task in the example usability study prompt 3 follow-up did you find these tasks easy or difficult to complete is there anything you would change considering i had to go back and forth between screens of the app that was not simple usually with any sort of checkout process there's an add to cart function i was just clicking on different buttons and to try to figure it out for example you may write something like this considering i had to go back and forth yeah that was not simple usually with any sort of checkout process there's an add to cart function now that you know why notes are important let's discuss who takes them as an entry level ux designer you won't run a usability study on your own or be expected to take all the notes if you have a ux researcher on your team they will likely run the study and take the notes even if there is a dedicated researcher for this study it's helpful for other team members involved in the project to attend and take notes why because each team member is most likely to notice issues that impact their work for example a ux writer might notice that a participant pressed the wrong button on the app because the wording was confusing on the other hand a ux designer might notice how long it took a user to find a button at google we take thorough notes in fact whether the study is conducted remotely or in person many team members will observe the study once the study is over everyone consolidates their notes and experiences then all these notes are distilled into key insights which inform the designs in the next stage of the design process now that you've learned why you take notes you'll learn how to take notes there's no right way to do it and everyone has a favorite note-taking method our usability study notes were messy on one sheet of paper you might also put each observation on a sticky note so your notes are easier to organize later if you want to be even more organized you can use a method called spreadsheet note-taking which we'll cover in the next video let's continue our conversation about taking notes during usability studies the notes you take will help you understand the user's point of view and first hand experience a simple and easy method to keep your notes organized is called spreadsheet note-taking you can use this spreadsheet to take notes about the entire usability study in one place so what is spreadsheet note taking and how can it keep your notes organized during a usability study let's investigate start by setting up the structure of your spreadsheet each participant from the usability study is listed in their own column across the top of the spreadsheet starting in column b each row of the spreadsheet contains a behavior or observation in column a before the study begins the team can fill out this observation column with a list of anticipated participant behaviors for example selects a date and time to schedule a dog walker which is based on the first question we're asking participants on the other hand the team can start the study with an empty observation column and add to the list in real time when behaviors are observed even if you choose to start with a list of observations it's okay to add additional ones during the study if the team chooses to fill out the observation column in advance it's helpful to organize it by categories you can even add color or borders to separate each category when taking notes you will match each participant to a corresponding observation you'll enter a 1 in the cell if the observation is true for that participant you'll leave the cell blank if it is false okay now let's try to take some notes together we'll re-watch part of participant b's recording and take notes as we go first let's make sure our note-taking spreadsheet is set up correctly looks like we have five participants across the top in the first row great now let's check the observations column our research team decided to fill it out before the study begins it looks like they even organized the observations into three categories observations about how easy or difficult it was for the participants to complete the assigned tasks observations about participants opinions on the product's usefulness and observations about the participants tone of voice or attitude while completing the tasks in the study they also left some extra rows where we can add additional observations now we're ready to take some notes let's start participant b's recording prompt 1 pick a date and time to schedule a dog walker note the product is only an example so you will not be able to change the date or time on the screen okay so to pick a dog walker i don't really know if dog walker's near you is how to schedule or if this scheduled rectangle thing is the way to go i'm a bit confused i'll try the scheduled thing okay cool it seems like that worked because the app went to the next screen i'm going to assume if this was clickable i'd see a calendar at this point or it looks like maybe these two rectangles or both boxes that i would type a date and time into interesting one thing i'm thinking about for myself and my own dogs is that it doesn't seem like there's a way to schedule a reoccurring dog walker like if i want someone to come walk the dog every week at the same time this scheduling page seems like it's only a one-time appointment for this one date and one time anyway i'll go ahead and click the submit thing which i think is a button prompt one follow-up did you find this task easy or difficult to complete is there anything you would change about the process of scheduling a dog walker i mean it was a bit hard to figure out which button to press on the home screen but that's okay that could be fixed but i still figured it out also i think there needs to be a way to do a reoccurring booking almost everyone i know with a dog doesn't schedule individual appointments like this they want someone to walk their dog at the same time or on the same day every week or something like that let's pause here participant b just completed the first task which tells us whether or not they can select a date and time to schedule a dog walker participant b said i'm going to assume if this was clickable i'd see a calendar at this point okay done based on this i'm going to put a 1 in cell c2 to show that participant b was able to select a date and time to schedule a dog walker participant b also said i don't really know if dog walker's near you is how to schedule or if this schedule a walk thing is the way to go i'm a bit confused so i'm also going to add a 1 in cell c3 because participant b was confused by how to get to the screen to select a date and time to schedule a dog walker this is an important part of the user flow let's start the recording again and make more notes about our observations prop two select a dog walker okay so it looks like there's a lot of options here and i can scroll through even more dog walkers any of these work for me so i'm going to click one of these rectangles that say learn more looks like i'm in the right place cool this seems like more details about a dog walker named jane doe prop 3 confirm booking of dog walker and complete the checkout process got it ok i'm going to click book right here this one seems obvious since it's big at the top of the screen oh that was super easy looks like i'm all set i have this congratulations page which i guess means my booking of a dog walker is all good prop 3 follow-up did you find this task easy or difficult to complete is there anything you would change wouldn't really change anything that was pretty easy i got it done quickly okay what did you observe was participant b able to choose a dog walker from the list you might have noticed when participant b said any of these work for me so i'm just going to click one of these rectangles that said learn more i'd say they were able to select a dog walker so i'm going to put a 1 in cell c4 next was purchased had been be able to complete the checkout process participant b said oh that was super easy looks like i'm all set on that one so i'll put a 1 in cell c6 let's revisit the recording and keep building our notes prompt four from the home page figure out where you would go to edit your address got it well let me see if i can go back here i think i need to press this x to get out of this screen ah yes i'm back on the home screen of the app cool so if i'm looking for a place to edit my address it's probably here under the logo for a person usually in other apps there's a profile page with all of your personal details like address so i wonder if this app will be the same great yes found it it says address right here okay was participant b able to find the user profile to edit their address participant b said cool so it's probably here under the logo for a person great found it participant b was able to easily find the user profile screen so i'll put a 1 in cell c8 back to the video one more time where we're going to look for some clues about participant b's tone of voice roll the tapes prop 5. would you use the dog walking app uh i don't know if that's useful especially since you can't book a recurring time like i don't really know if i would just book a dog walker one date at a time seems like a lot of effort to be honest i don't think i'd really use it the way it's currently set up but thanks for letting me try it out what did you notice about how participant b answered this question one thing they said was i don't know if it's that useful especially since you can't book a recurring time so i'll add a one in cell c11 there's one important part of the spreadsheet that we need to fill in what did you notice about participant b's tone of voice and attitude which cell do we want to add a 1 to in this section i observed that participant b sounded indifferent so i'm going to put a 1 in cell c13 hopefully you're getting a feel for how to take notes in a spreadsheet you're off to a great start after the study is completed and you've added all of your notes to the spreadsheet it will be easy to identify the most common participant behaviors and the tasks participants found easy or difficult and there you have it you know how to use spreadsheet note-taking during a usability study now it's your turn to practice this skill during your next activity good luck congratulations on finishing this course from the google ux design certificate you can access the full experience including job search help and start to earn your certificate by clicking on the icon or the link in the description below watch the next video in the course by clicking here and subscribe to our channel for more from upcoming google career certificates