all right thank you for waiting uh any questions before we get started all right um so i just posted i was out on tuesday so there's only one video up i just posted it early this morning late last night so you probably haven't seen it but we've been talking about this week continuing is conditioning we had talked about that with you guys on thursday looking at classical conditioning is that right for this class and so on wednesday yesterday we talked about operant conditioning so check that out if you if you haven't had a chance we're going to talk about today is related mostly to operant conditioning but you could also apply these techniques to [Music] the classical conditioning and what we call this is reinforcement schedule so yesterday just to briefly catch you guys up we talked about how you can have a positive or a negative reinforcer and a positive and a negative punishment such that you get positive reinforcement negative reinforcement positive punishment and negative punishment positive reinforcement let me say it this way positive always means that i'm giving you something i'm doing something to you or i'm giving something to you whereas negative always means that i'm taking something from you reinforcement always means always and necessarily means that i'm going to increase behavior a reinforcement always and necessarily increases behavior whereas a punishment always and necessarily decreases behavior this is an important distinction because we can't just classify certain actions certain behaviors as reinforcers or punishers let's take for example uh let's say i'm teaching a high school class this doesn't usually apply to college classes let's say i'm teaching a high school class and there's somebody in the back they keep talking through the whole class and i'm trying to get the lecture and they're interrupting and talking to their buddy or whatever it is and i say hey uh stop talking i'm gonna yell at you all class you're such an idiot calling names all this stuff whatever next class he talks more so what have i done him have i punished him you're saying no why not okay so i just told him what i thought i didn't really do anything but why isn't that a punishment i yelled at him isn't that punishing his men because it didn't decrease his behavior in fact what happened it increased his behavior so my yelling was actually what no not positive punishment punishment still decreased behavior yeah positive reinforcement it was a reinforcement right it's a positive reinforcement reinforcements always increase behavior if i've done something even if i need it as a punishment and it increases his behavior well then i'm reinforcing yes about to cover this ma'am would negative reinforcement work then sure let me let me finish this point and then i will i will do that um so it is just that last little piece it is just important to understand that you can't classify any behavior as just being a punishment or the enforcer maybe he did really well on the test and i wanted to and i wanted to reward him for that and i said hey man you did so good on the test after you know you've been such an in class when you come up here and tell everybody how you did so perfect on my test come on up here where are my introverts most of y'all you're so quiet do you like that no huh no you want to come up here and tell the class whether whether you like it or not no okay one goal so what would what would it mean for you to come up here if i made you do that i don't know would you try as hard as my test you probably would but the idea right is that potentially i'm trying to reinforce here but potentially i'm punishing someone i ask for introverts not necessarily that they're always shy but they may be less likely to want to get the spotlight to have the professor call them up and shine in front of the class now if i got some extroverts would really like that uh but for that particular person it might be a punisher so again you can flip those over too even if i mean something to be reinforcing sometimes i can be punishing somebody you really gotta know your subject it's not just blanket things right money you might say oh that's for everybody but it might not be um so just yeah real quick so again a positive reinforcement means i'm going to give you something to reinforce behavior to increase behavior this is usually going to be like some type of reward this might be some type of money food these type of things a pat on the back okay so i'm going to give something to you to increase your behavior a negative reinforcer is kind of interesting and in the last video you'll see that we take some time to explain this but i'll just tell you it means that i'm taking something away from you to increase your behavior now it sounds tricky until you think about what type of thing i have to take away which is to say i have to take away in order to increase behavior i have to take away something that you don't like right if everybody comes to class next thursday i'll take away one of your tests right that's not true i'm sorry but that idea of hey he's going to take something away that we don't want is reinforcing it makes you in most cases unless you like tests who knows but it makes you probably want to come to class because hey i'm going to lose something i didn't want anyway um there's also some interesting ways this happens with non-human objects and animals so your dog probably does this if you have a dog maybe cat too that when it wants to be wet outside it does something kind of annoying [Music] okay shut up i'll let you outside right so it institutes this thing that's kind of annoying to you until you do what it wants and then it stops that thing right so i've taken that noise away to reinforce the behavior of hey this is when you let me out and if you want to let me out if you want me to stop that you better let me out babies do it crying until they're fed i'll stop crying if you feed me stop crying if you change my diaper cars do this i'll stop beeping at you when you turn the lights off i'll stop beeping at you when you put your seatbelt on right so all of those things institute something kind of annoying really and then take it away because that's the reinforcement so positive and negative punishment uh serve a similar purpose sorry where of course in a positive punishment what you're doing is giving something to decrease behavior and so this is like a spanking um i say here's your conservative parents here's your liberal parents for punisher right spankings time out right so here i'm giving you something to decrease behavior a swallow in the bud or whatever right and here right conservative parents i'm kidding good negative punishment i'm going to take something away to decrease behavior right liberal parents time out okay um again you do whatever you want but i just say that for a way for you to remember it this is going to be me taking away of course something you want your cell phone your free time your car right in order to get you to decrease behavior so if you show up late again you can't use a car on the weekend all right well you're taking something i want so i'm less likely to do the thing that would cause that to happen does this make sense any questions about um reinforcements all right let's look at a little video here she funny writing makes your school work better [Music] meet grammarly are you finished well thank you how thoughtful would you like a job uh yeah sure thanks oh sorry sheldon i almost sat in your spot did you i didn't know this have a chocolate thank you [Music] you're here a lot now oh am i talking too much i'm sorry thank you [Music] [Music] yeah you know what hold on let me take this in the hall okay i know what you're doing really yes you're using chocolates as positive reinforcement for what you consider correct behavior very good [Music] actually it turns out i can well you shouldn't there's just no pleasing us you weren't happy with my previous approach to dealing with her so i decided to employ awkward conditioning techniques building on the works of thorndike and bf skinner if by this time next week i believe i can have her jumping out of a pool balancing a beach ball on her nose no this has to stop now i'm not suggesting we really make her jump out of a pool i thought the bazinga was implied who's tweaking her personality he's standing off the rough edges if you will no you're not sanding kenny are you saying that i am forbidden from applying a harmless scientifically valid protocol that will make our lives better yes you're forbidden [Music] bad leonard you know using positive reinforcement techniques i could train that behavior out of her when we no if you let me use negative reinforcement before we go to bed no of course not we're talking very mild electric shocks no tissue damage whatsoever forget it oh come on you can't tell me that you're not intrigued about the possibility of building a better girlfriend well a great quality both good and bad are what make her who she [Music] you mean like that is irritating laugh [Music] yes [Music] we're not changing how penny laughs no that would be in congress [Music] freaky yeah freaky chocolate thank you i'm going to make some warm milk and then turn in i trust if you two are planning on engaging in amorous activities you'll keep the decibel level to a minimum of course thank you unbelievable [Music] i was just thinking we should probably turn well my into bed got delivered come over and put it together you could stay at my place really that's a lot of work and it's kind of late yeah to say that we won't have to be quiet let's go interesting sex works even better than chocolate to modify behavior what if anyone else has stumbled onto that all right [Music] um very good so yeah there's a way it's done obviously here in a comedy sketch but um yeah that's that's some real ways that you might use a positive reinforcement um i told my class yesterday that it is a bit i don't know unethical or um maybe even immoral to probably use these techniques on people without their consent i mean leonard in this clip is bringing that up right he's saying like you know don't be training my girlfriend um because right it is a bit uh manipulative to do but uh we often do this of course with animals when we're training animals you'll see that we're using this he makes a reference a lab rat in the video and if you've ever heard of and i know we've talked about it a little bit in here behavioral tech behavioral technology behavioral counseling or applied behavioral analysis sometimes called we have a program uh here at the university um just just uh in this department even um and this is what they're basically doing now you're signing up for it so it's not manipulative like you show up that you don't know what you're getting into but in this case right you're asking them hey i want some behavior changed usually these are going to be more behavioral things than they are going to be psychological things so i want to stop smoking i want to lose weight often these techniques are used for instance with autistic children who maybe have a little bit harder time depending on the level of severity but maybe have a little bit harder time kind of negotiating good behavior hey billy if you uh are good for the next week we'll take it i don't know worlds of fun or something like that they might not be able to have that interaction or to remember or to hold on to that promise and so this type of technique is often used to kind of just curb their behavior some people might still think that that's a bit ethically ambiguous their parents are signing them up for it uh but it does seem to be relatively effective for folks who maybe haven't would have a difficult time in a more regular therapeutic model or just talking to you yes sir do you think there's like a line when it comes to like reinforcements and like thinking it's unethical because like you could do positive reinforcement by telling people they did a good job on something and like continue that and so people will either continue to do a good job but like that doesn't seem so unethical that's a great question and so i don't mean it in kind of a casual interaction the reason this works on us is because we do it all the time right we you know somebody says something nice and you smile at them that's a positive reinforcement um i mean it more like and i tell the story a little bit yesterday i had a buddy and you know i talk about what i do and i'm telling him about some of this stuff sometimes i mean i really found it really boring to drink with but uh so we're talking about this and i'm you know telling him about it and then a week later he's like hey remember when you were telling me about that uh reinforcement stuff that behavioral stuff it's like yeah he's like yeah i've been using it on people at work all the time it's working great no no you can't just show up and you know do that type of thing to people you know folks would you know give him something on time or say something he liked and he'd figure out some way uh to reinforce them i'm like that is a bit manipulative so it's that type of contrived i'm gonna set it up uh i'm gonna get people to act how i want them to act that's the unethical piece again we kind of just do it naturally all the time yes sir well i was thinking um the lines like if you're a personal trainer and your goal is to get them to enjoy like is there like can you could you use that in your current your job yeah i mean i think anytime somebody signs up to be instructed coached trained by you right that they're signing up for you to motivate to move them right and so all of these are those type of techniques um they know that they came to you because they want to get in better shape or they want to eat better or whatever it is and so you saying hey every time you show up to the gym or even not even saying it but every time they show up to the gym just being really positive and really really nice for them so that that's a good experience that's part of your job right and they would expect that uh of you versus again just somebody that you're interacting with and you're you know trying to get them to say something nice to you more often whatever it is good question anything else on these okay um so uh one of the last things and sheldon just reminded me of this that uh is said in that video is sheldon says uh oh it turns out that sex is an even better uh reinforcer than his candy i wonder if anybody else has figured this out and he's actually talking about something that we do think about which is the difference between primary and secondary reinforcers same so primary and secondary reinforcers primary reinforcers are things that we don't need to learn are reinforcing these are just things that are already desirable to us things that we already want things that already are rewarding to us without having to learn that it's rewarding secondary reinforcers are things that we have to learn to like we have to be talked into it we have to be convinced or socialized that hey this is a good thing you want this and often what you'll find is really the primary excuse me the secondary reinforcers are just a way of getting the primary reinforcers or kind of a backup or a shortcut what do you think are primary reinforcers yes sir uh i have no idea sheldon gave us one so that's either like uh candy oh candy you're not wrong but broaden it uh wanna open a tree like a tree of some sort what's that food right you could say treats but that could be a number of things but specifically we're meaning food here right you don't have to learn to like food now you're not always hungry but if you're hungry this is already a reinforcement hey you haven't eaten in a week come to class i've got a bunch of pizzas right well people are going to come to class now because i don't have to teach you to like food you already knew about it what else sex now you have to maybe grow into this but by the time you know what sex is or really sexual pleasure that's going to work we can also just say maybe as an analog of this pleasure we want to distinguish what else by the way as i say primary reinforcers i do also mean punishers you can think of a negative construct there too what's that pain very good and the reason actually we can still call this a reinforcer because we can negatively reinforce you with pain right it'll give you some pain and if you do what i say i'll take it away what else sleep sleep very good you don't have to learn to like sleep anything else a shelter um yes kind of but i think really what we're seeking there is safety but maybe shelter in itself as modern humans we're almost always sheltered so it's tough to know you know what maybe it feels like to want it because like i know my dog you know a little bit he immediately wants to go in so sure i mean it could be basically it could be safe but yeah we'll say slash shuffler um none of you gave me the tricky one that i thought that i often get that people think is a primary reinforcer you know what i'm talking about if you think about it it's not but often it's the first thing people say money right why isn't money a primary reinforcer you have to know the value of it right you ever give a two-year-old dollar bill or ask them if they want a dollar bill or a coin anybody have this experience what happens actually so she actually took it i guess she learned it she learned to like collect it but she didn't know what it meant after sure so she knew it was for something she didn't know really what to do with it good anybody ever doing this option most kids want the coin why does it shine is it shiny right and maybe pleasing to the eye right that's that's all they see but we have this intuitive money but what gets all of this right the kids don't learn that yet so it is a secondary reinforcement is fear a primary or a secondary great fear is definitely primary i have to learn to be afraid it comes built in good question but does it not work as a secondary as well like the fear of pain the fear of pleasure almost for your not being able to sleep stuff like that or is that just working it's it's that's a great question because it is sometimes maybe pointing to some of these things but the fear itself is motivating to you and you're saying something interesting because it's sort of a built-in secondary reinforcer but because it's built in its primary because it is warning us it is not in and of itself dangerous right whereas pain tends to be that's a great question anything else here anything you like really right i'm gonna put uh fashion sometimes people say clothes so i would distinguish between clothing and fashion it's more of a safety shelter piece orders here it's like oh i'm going to look good what else could it be something like success some success drives a pleasure i think just you know because if you succeeded something what is the success for why are you successful no no why did you become successful no no i mean like if you succeed at something like you know throughout the program and it works you know that success starts pleasure oh you're saying the the sort of accomplishment yeah in and of itself yes good is that a primary i would say it's primary i'll tell you why uh because because we're sort of missing a big one on the primary reinforcers uh you can put anything over here anything that you like right if you like cars if you like watching sports if you like movies right anything can be a secondary reinforcer hey if you show up to class two days in a row i'll give you free movie tickets not that you can use them but here they are right so whatever it is right if you liked that thing that would be reinforcing to you um but over here there's a big one that we're missing that i think is related to accomplishment i think it's why i put it here and was asking you know some questions about it what's missing we're in a psychology class let's miss it emotions like sometimes an emotion okay come on you cold bastards what should make you happy sure we can put here let's just do dopamine okay there now we've skipped all the emotional ones it is kind of emotional but exactly it's a feeling joy um he just lied for love or something but love of course right you do things to have people like you you do things to have people care about you you do things because you care about people isn't that just secondary though because it falls into accomplishment no you're a human boy animal the reason why by your name is because of the pleasure it gives you so therefore secondary that leads to pleasure no the love in and of itself is not pleasure in fact if we're calling pleasure dopamine uh love is oxytocin right it's a whole different little different chemical we can break this up a little bit and call it social capital because that sort of clears it up a bit because love is sort of one thing and it's included here but we also sometimes just do things to get credit socially we also sometimes just do things so not that people will love us but that they won't hate us or that they'll like us or that they'll think accomplished or steam just makes sense this idea of social capital and in fact i would say to your question isn't it secondary that it is the most primary is the most primary reinforcement as humans it's the thing that we need the most we gotta be part of the pack we have to be nobody's helping us eat and shelter right there's so much stuff to take care of in a modern society you can get it on the internet or just go to a grocery store right but we are built to live in a modern society we're built to live in a private society and so in that time we have this really hard code that says get along with people be a part of the group it's why everybody in here is wearing virtually the same thing no togas today no kilts right because you don't want to stand out in that way it is somewhat important on a day-to-day level to fit in with the crowd uh because again we're pack animals and like any other pack animal there's strength in numbers and if you stand out you're a target so don't stand out get people to like you and if you can get them to love you because then they'll do a lot of stuff we're not doing this manipulatively but it's how we're built believe me i said do you believe in some sense i think it is i feel like the idea that it's not manipulative is false just because it's very nature to want someone to do something else for you to say it uh there's this there's this soap right called um i think it's called like advice for sociopaths hello um and i was writing an article once uh actually i wrote it because i found the link and basically it is all these things that sociopaths are telling each other as a way to fit in and they sound really manipulative when you read them if you want people to do things for you give them treats what you basically saw here if you don't want somebody to to talk to you anymore say something slightly negative about the thing they're saying hey to tell you about my kids baseball game last night i hate kids okay i'm gonna talk i'm just gonna leave and you can talk to me a little bit but not too much but enough that i shut up uh the most famous one there this isn't uh to my point but i was remembered to yawn apparently yawning is an empathic quality and the fact that we on other people beyond that that's empathy that that's you i feel whatever yawning means tired or we still don't really know and i transmit that feeling to you and you just yawn sociopaths don't have that quality they do not yawn reflexively they do not young in response to other people yawning so one of the things to say was remember to be on normal people beyond it's fascinating anyway so um any other questions i kind of got on a tangent there but do you want to move on to this so reinforcement schedules check my spelling so these schedules are interested in how often how regularly and in some cases by what mechanism should we apply our reinforcement in order to do one of and or two things which is to say one how do we get the subject to learn the desired behavior or to repeat or engage in the desired behavior as quickly as possible how do we get them to pick this up as quickly as possible how do we get them to learn as quickly as possible this is our one consideration our other consideration is how do we get them to maintain that behavior even once we've stopped reinforcing them how do we get it to stick such that when i'm gone the behavior doesn't extinguish doesn't go extinct so we're trying to juggle these two things of how do i get it to be learned quickly and how do i get it to stick the first way that we can begin to split up this scheduling so literally we're just talking about how often do i apply the reinforcement you can also think about punishment i will just say reinforcement the first way is to think about applying it every time every time every time every time so if i'm trying to teach my dog to sit on command and i say sit and i give him a treat if i'm using a continuous reinforcement schedule every time i say sit and he sits i'm going to give him a treat every time every time every time this makes sense if i'm using an intermittent schedule now this is just a simple breakdown we're going to make it a lot more complicated if i'm using an intermittent schedule it just means i'm not going to give it to him any every time sometimes he sits and i just say good boy or i just get him to stand up again and then i get him to sit again and then maybe i'll give him a treat that time briefly if i can i i talked about this yesterday too but for you guys something sort of fascinating about these schedules and one of the reasons they work is because of the way reinforcement happens in the brain so here we just have time and then on the side here we have a scale of dopamine if you remember dopamine here it's just pleasure it is how your body generally rewards itself if you like something if it tastes good if it feels good if it smells good pleasurable to you uh your body has released dopamine this is the way your body communicates pleasure to you and so we can uh see pleasure we can see excitement uh just by looking at dopamine for the most part so over time here's a training session with my dog where i say sit here here he sits and here i give him a treat where do you think the dog is going to show the highest level of dopamine when he gets the treat any other guys it's actually right here between his sitting and him getting the truth so sit oh you know something's up he gets excited since he knows he's sat now so he's what's this feeling anticipation that's it right you know that feeling that's the peak oh it's gonna and then once he actually gets the treat it plateaus or drops a little bit actually now this is if i give him the treat what happens if i don't give him the treat he gets excited even before i've given it to him is it going to sharply increase or sharply decrease it's going to sharply decrease right so here he is expecting this thing and when i don't give it to him when i build it you get this quick drop off the difference between this line and this line is that this is rewarding or reinforcing this is actually a mild punishment in a way it's a strange punishment because it feels like a punishment doesn't feel good you ever had something you really wanted and you thought you were just about to get it and then it fell on the floor right it feels worse than if you hadn't had it at all and so you have this mild punishment that happens but as a result the dog well what happens who's got a dog and this happens let's say you're doing this training regimen and every other time you've given him the treat when he sat and this time you didn't give him the treat okay so maybe he whines and sad and then what see girl sit down this what's he do you're way too patient yeah i would say yes and i would say he's probably okay i'm gonna do it perfect this time boss i promise i would say that he's gonna get more into right because he knows it's possible this has been happening i must have done something wrong okay i'm gonna do it perfect this time right and so the psychology here is that the dog wants to improve the person wants to improve right and it's important that he has that anticipation that he thinks it's coming or at least he knows it might come because once you start this this actual anticipation is going to go higher once you stop reinforcing it every time the anticipation is actually going to increase because the anticipation hangs on this balance of i think it's about to come but i'm not sure there's an excitement in that there's some excitement and anticipation where there isn't uncertainty and so you'll get this increase in in this excitement phase and in fact if we measure how how high can we get this what's the ratio of giving him the treat and not giving him the treat that will make him the most excited at that anticipation point it's actually 50 50. right it's weird i think that our brain can do that when it's as equally likely as unlikely that's the max anticipation right when you start making it less likely i usually don't get a treat so when you start making it more likely well i usually get a treat you know so the anticipation isn't as high you're gonna need it to be right but when you're not sure that's when it really feels like oh boy let's see what happens yes you give a reward but you have two different kinds of rewards like you know instead of giving them a treat maybe you give them like affection does that like does that look in the same sense but without that drop-off that you know maybe there's a plateau if you give instead of food you get an infection you're saying if you don't give him the infection no no so like if you have not instead of just switching on trees like instead of having the punishment of not giving him a treat he gets pet or he gets oh you give a good one to the other yeah i think it'll be less effective right because he's still gonna get a little bit of a maybe it's not what he wanted and maybe there's not as much of a drop off but what you want is that heart-sinking feeling of what i have to do to get it right that's that's what you're trying to get in the field if he's like oh this isn't so bad i mean he's probably gonna keep working but uh okay let's yes sir um do you think like eventually they stop necessarily pouring the tree or like it just becomes like natural for them to just like when you say sit they sit because they've been trained to do that almost it's a great question and this is exactly where we're going to go okay great question so we looked at continuous and intermittent all we're really going to focus on are intermittent i'll tell you some stuff about continuous um in the this but uh we're really just going to focus on the intermittent because that's where it gets interesting continuous every time intermittent we got to think of how we're going to not give it to him when and how so the first two types of scheduling are ratio scheduling versus interval scheduling so ratio scheduling versus intermittent scheduling sorry intervals in a ratio schedule it gets a little complicated in a ratio schedule the let's say dog performs an action and then based on the dog's action or success uh these aren't any real nomenclature of describing things based on the dog's success or failure at that action i either give them a treat or i don't give him a treat so the action happens it sounds like i'm saying what i've been saying but keep up the action happens and then i reward him or not based on that action in an interval schedule and we'll come back to this because there's more to say but the difference between that in an interval schedule is in an interval schedule i'm going to open up an amount of time for in this case the dog to complete some action that i want i'm going to give him an amount of time to complete that action and if he completes it in the allotted time then at the end of the time say this is five seconds at the end of the five seconds i give him the treat if anywhere in here he did the desired behavior if he does before no if he does it after no but when the trial starts okay go this might be this happens there's something i do with my dog not on purpose but it turns out that way i let my dog out when i get home i'll go do what i need to do you know in the house it's kind of putting clothes away get out of my work clothes i'll go back to the door i'll call my dog mice come how long am i going to wait there 30 seconds i'm a minute well that's how long he's got to get inside now i'm not just trying to make him run as fast as he can but you know sometimes he's outside chasing a rabbit or you know playing the neighbor's kids and so i give him an amount of time at which and in this case the reward is just coming inside shelter and if he can get there before i go away then he gets to come inside if he can't get there if he's busy or maybe just slow or i'm impatient right and by the time he gets there well the door is closed so he can't come inside so here's an intermittent reinforcement guess what this makes him do when he wants to come inside and he hears me by his tongue he runs as fast as he can right if i want to go inside i only have five seconds 20 seconds to get through the door so go right this is good for training i want my dog to come as soon as i say come so if i give him this schedule this interval at which he can get inside i don't just wait forever right it'll just leave the door open well now he knows when he hears me saying come inside he better get to it just make sense sometimes this will happen for instance in a lab uh where we might set up the difference between ratio and interval is where we might set up a little switch for a mouse to press and the treat will fall out occasionally in a ratio schedule right anytime not any time but after he presses the lever the treat gets dispensed now what you should also understand and really the more important part of the ratio scheduling how is it interval if i just give him the treat every time well in a ratio schedule you don't have to give it every time you can but then it's continuous but it might be that i want you to press that lever three times and then after the third time a treat will come out it might be that i want you to press that lever two times and then after twice the treat comes out it might be four times and then a treat comes out the key feature here is that it happens after a set amount of presses a set amount of accomplishments right after that number that i've set up after three because i set up three you get the treat after two because i set up two you get the treat in this same scenario this mouse pressing a lever for treats if we're gonna set up an interval schedule we're going to need to let the mouse know that the interval has started in some way right with my dog it was my voice come inside okay here's now the time is going for a mouse the way we usually do this is in their little box with the lever there's a light the mouse is hanging out and when the light comes on right the mouse has been trained in some way to realize that when the light comes on here's your interval maybe it's going to be on for i don't know 15 seconds and if he can press the lever within that 15 seconds the treat will come out does that make sense it's got to happen within the amount of time it can't just happen anytime and the ratio schedule anytime he wants he can just show up and press this lever however many times i've set up and he'll get the treat in the interval schedule it's only when the slide's on the doll can only come inside when i've called him because that's when the doors are just make sense this interval is about within a set amount of time and the ratio is about a number of accomplishments a number of times sorry okay we can finish so there's these other two sets of words that we're going to add to these these are a little simpler this is fixed versus variable fixed versus variable all this means is if i'm going to set up several trials is the number of times or the amount of time are those things locked in or are they going to vary every time so our mouse getting the tree out of the cage if it's a fixed ratio schedule well that's going to look like the first time shows me every time it's going to be two presses if it's fixed every time fixed at two if it's a variable ratio of schedule if it's a variable ratio schedule every time is going to be different the first time is three the second time is two the fourth time the third time is four the fourth time is three again so here this ratio is varying it's still after they do the certain number of accomplishments but at every trial i'm changing how many that is the mouse can press the lever to get a treat out anytime he wants but he never knows how many presses the next one is a hundred okay if i do a fixed interval schedule of course that means my dog always has five seconds to get inside every time i time but i don't so really i'm working on a variable interval schedule sometimes it's 25 seconds sometimes it's 65 seconds sometimes it's a whole second hey out there nope all right back to him again so it's just about whether these things are changing or whether they're staying the same does this make sense all right last thing is a little thought exercise for it let's say i've got a kid called tommy and i want to get tommy to keep his room are you tommy to keep his room clean which schedule and why should i put him on in order to get him to keep his room clean end very good so if i put him on a fixed ratio schedule let's say we're using money here fixed ratio schedule would mean what when do i give him that money what do i give him money in a fixed ratio skip it would be something like hey tommy every time you've cleaned your room twice i'll give you 10 bucks every second time you clean your room i'll give you 10 bucks kind of behavior does this result in what's tommy going to do when he wants money what's up clean his room twice he's going to clean his room twice that also requires what messing it up probably right clean it up look down and clean it okay get out all right mess it up see it's messy and then come back look it cleaned it again right 20 bucks right then so the problem with this is that he's got a lot of control and if i'm trying to change the behavior of his i really want to give him this much control this particular schedule is really good for getting someone to learn something fast in fact if you do it in a continuous way it's especially fast if my dog does not know what the word sit means and i'm trying to teach him that this means to put your butt on the ground i want to reinforce him at a regular pace and probably at first continuously so that he gets oh that's what he wants oh that's what he wants so this schedule is good for when i said getting you to learn it fastly this is faster quickly this is the one that you're going to use if you want someone to learn something quickly i'm going to reward you every time so that you get what i'm telling you so you get what i mean a variable ratio if we're talking about uh tommy again a variable ratio is going to look like hey um every time you clean your room a certain amount of times i will give you some money i'm not going to tell you how many that is might be two might be one might be five what kind of behavior does this create good and most folks don't add that second piece but the answer i'm looking for is he's probably gonna clean his room constantly if he wants that money if we put our mice in that cage that i talked about and instead of dispensing a treat we dispense some dopamine and a little oxytocin into their brain this feels like an orgasm if that's the treat that they get for pressing that lever and we put them on a variable ratio schedule that is to say eventually when you press it you're going to get this feeling but you don't know how many times you have to press it so you press it three times but you've learned maybe in the past that the next one's a hundred so guess what i better get started so what's gonna happen is in this schedule you're right that mouse will press that lever to death i gotta keep pressing it i don't know where the next one's gonna go this is an addiction basically it's also how slot machines work right eventually i'm going to be a millionaire just keep pulling it till that happens right this is how slot machines work if you want somebody to do a behavior continuously to not stop to just do it over and over again this is your saying don't tell them when they're getting rewarded but say eventually it's going to show up just keep working fixed interval would be something like hey billy every friday i'm going to check your room i'm going to check your room if it's clean on friday you get your money right so your interval is the week if anywhere in that week i can you can prove that your room was cleaned that is to say it is clean then i'll give you some money what's billy going to do she's going to glee's room on friday right he's not gonna keep it clean which is what i wanted to do he's gonna clean it before i check and so here in this variable excuse me this fixed interval they're usually just gonna wait because they know how long it is come inside he'll be there second 24 not going to run as fast as he can just going to get there when he knows they're still high so this one is good for getting the job done but not necessarily getting it done or keeping it done here's your answer and you gave it to us uh at the beginning which is to say the variable interval the you don't know when i'm going to check but at some day i'm going to check it if it's done at that time then you get your money well again if my goal is to keep your room clean you just need to have it clean i don't care when you cleaned it and i can show up anytime so if this is the schedule that you would use if you want consistency this is also the schedule that you would use if you want longevity if you want somebody not to do something continuously but to do it often and without having to be reminded or to keep it that way does this make sense so quickest most frantic and longest this one somewhere in between thank you guys for staying and again sorry i was late happy weekend