Pages

Sunday, July 31, 2016

Whispering Dogs

There's talk of dog whisperers and horse whisperers and ghost whisperers- wait, that last one I'm not so sure about. Anyway, people can call themselves whatever they want, but it's actually more important to hear a dog whisper than whisper to a dog. How does one listen to a dog? It actually has much more to do with observing than listening, though your ears will come in handy.Dogs are always communicating with us and we are often too ignorant to realize it because they communicate mostly in tiny signals. It's not entirely our fault that we are ignorant to these tiny things; they are tiny and fleeting and generally below our eye level. The thing is, we owe it to our dogs to try a bit harder. This guy summed it up nicely:
“A dog is the only thing on earth that loves you more than he loves himself.”
—Josh Billings 

It's usually those little things that tell us what our dog is feeling and thinking. By understanding these little things, we can actually be better people for our dogs. Imagine, knowing the instant your dog is bothered by the toddler grabbing his tail (ok that one is pretty obvious), by the heavy-handed petting by crazy aunt Myrtle, or that the new puppy is just too much for your 13 year old dog to have patience for. When we see and understand these things, we can get our dog out of situations before anything bad happens and we can be much more successful with training and behavior modification. If you can't tell when your dog is going over threshold when working with a scary stimulus, how can you be sure you are doing behavior modification correctly? If you can't see that your pup is getting more and more agitated in class, how can you expect them to focus on you or learn anything?
I'll put this in more human terms to demonstrate the escalation of behaviors. In a way, dogs have three basic levels of talking to us- whispering, talking, and yelling. 
Whispering is the first signal they are uneasy about something and they will try to whisper until they feel they are not being heard. Whispers are little body language signals which a dog exhibits to express their discomfort. A lot of whispers are actually displacement behaviors and calming behaviors, which are used by dogs in an attempt to diffuse stressful situations and communicate that they are not a threat to that scary stimulus. 
If their whispering is ignored, dogs will try talking, which are signals that are a little more obvious (at least to the dog). Dogs will usually still offer displacement and calming signals at this point, but will probably offer more stress reactions to let you know that they want out of the situation. 
When those two are ignored and the dog feels under severe stress or pressure, they start yelling. As people, we tend to wait until our dog is yelling to do anything. Dogs will no longer offer displacement or calming behaviors at this point, because they see it as pointless- they have been trying those for so long and they have been ignored so they need to protect themselves at this point. The yelling is actually what we people are great at seeing, but by then your dog is at or way over threshold and might as well be having a panic attack. 
This is where people who use shock collars make their money- a dog who is way over threshold cannot be lured back with treat or toy and can't be called back with commands, just as you would not be talked out of a panic attack by someone saying "oh, it's ok, just calm down- have a cookie." That's not how the brain works. By the time a dog is that upset, they are in fight or flight mode and digestion is the last thing (literally) on their mind. Then, someone comes in with a coercive method like a physical correction. Aside from removing the dog from the situation, something like this will unfortunately be the only way to get their attention in that situation, because pain or discomfort is the only thing that will register with the part of their brain that has taken over. The problem with this method lies in the fallout- a dog is unsure of kids on bicycles, then one day one gets way too close and the next thing that pup knows, she is getting yanked around by the neck or shocked. Why on earth would she ever begin to like kids or bicycles?! That only reinforces her beliefs that kids and bicycles are dangerous. A much better method is to first know when a dog is showing little signs of stress and help them cope at that level, then gradually add in higher level stressors as long as they stay under threshold. Ideally, this is done under the instruction of a professional trainer or behaviorist. Here are a few examples of each:
Whispering: lip lick, short stare, slight head turn, scratching frequently or out of context (like in the middle of play), sniffing the ground out of context (in the middle of play or when meeting someone), leaning away, looking away, low tail, yawning, moving slowly
Talking: hyper-vigilant (looking around quickly), excessive yawning, panting when it's not hot, freezing in position, moving away, "whale eye" (looking so far in one direction that you see the whites of the dog's eyes), sudden loss of appetite, tucked tail, curved spine, dilated pupils, shaking/trembling, shaking off (this is a displacement behavior that we see frequently in play)
Yelling: lip lift, closed mouth, showing teeth snarling, growling, barking, lunging, biting 
Look back over those signals. There are a lot of them, and that's just the ones we humans can easily perceive. Dogs will always use these signals before they do something like biting. The only times they don't are when they are consistently ignored or punished for whispering or talking; then they go to just yelling all the time. This is how we get dogs who seem to bit out of nowhere, or dogs who "seem fine" and then "suddenly bite". Short of a chemical imbalance, it is quite rare for a dog to go from "fine" to biting. 
Usually, a dog who is just not reacting visibly is what most people see as "fine". A small dog who is very still and looking away from a big, scary dog is just "fine", right? Wrong. They are uneasy and trying to say so as politely as possible. If you don't give them some distance from that big scary dog, they will start talking louder and yelling. 
I hope this gives you some insight into your dog and can help you to be a better dog owner. Don't you want to be the best possible person for a face like this?

Resources and recommended reading on this topic. 
I have included so many resources on this one because I believe that understanding your dog is the most important part of owning a dog (short of feeding and medical care, that is).
Interview w/Pam Dennison on reactivity
http://www.dogcastradio.com/flashplayer.php?episode=155On Talking Terms With Dogs: Calming Signals, Turid RugaasCalming Signals: What Your Dog Tells You – DVD – Turid RugaasThe Other End of the Leash – Why We Do What We Do Around Dogs, Patricia B. McConnell, Ph.D.Stress in Dogs, Martina Scholz and Clarissa von ReinhardtThe Language of Dogs – Understanding Canine Body Language and Other Signals- DVD’s – Sarah Kalnajs


x

Sunday, July 10, 2016

The Nitty Gritty of Clean Training, Part 2: Reinforcement Schedules

As someone who uses reward based training, I hear this one all the time: "but if I train with treats, my dog will only ever listen when I have treats!"
That could be true- if you never change your reinforcement schedule and never fade out food treats. If you work with a trainer who understands reinforcement schedules and how to use them to fade out food treats and fine tune behavior, this is never a problem.

I will fight my natural tendency to give way more information than is necessary in this post, but this is one of those topics that gets a bit tricky so I use extra words to explain and re-explain myself. I apologize in advance for all the repetition.

A reinforcement schedule is a rule or pre-set program that determines how and when a response will be rewarded. Different stages of learning use different reinforcement schedules- when learning a new behavior we reward differently than when strengthening or proofing a known behavior. We also use different reinforcement schedules for different reasons in training, depending on the behavior we are encouraging or discouraging.

Look at you, learning about training! 
Easy, painless, and you are still awake. 
Let's dive in to the good stuff! 

When I being training a new behavior or cue with a dog, we will begin with a Continuous Reinforcement Schedule, which abbreviated as CRF. In this type of reinforcement, the dog gets a reward every time they offer the desired behavior. We use this when teaching new behaviors because we want the dog to learn that the new behavior is a really great thing to do- it always gets attention and a treat! If your dog gets a treat, pat on the head, and an enthusiastic "good boy!" every time he sits; he's going to try sitting more often. This comes in handy when we build behaviors on top of each other, because they always have a strong base behavior to fall back on if there is a regression in training. Regression can happen because training suddenly stops for a period of time or because of a change in environment/stimuli. When using a CRF, it is important to only use it until the dog understands the behavior, then switch to a less predictable schedule (this is also when we begin to give different rewards based on the quality of response, but that's covered below in Differential Reinforcement Schedules).

Partial Reinforcement Schedules (PRF) reward the desired response only after certain responses, either after a set ratio (number of responses) or interval (period of time). We can use these schedules to fine tune behavior once the basics are understood.
Within this schedule, there are five different types of reinforcement:
  1. Fixed Ratio: The dog gets a reward after a predetermined number of responses. For example, you can train your dog to "count" using this method by rewarding after say, three barks and labeling it "count to three". This could be done with any number, of course! 
  2. Variable Ratio: The dog gets rewarded after a different number of responses, but the average of them getting the reward is determined by you. If you want an average of three responses, you would reward for: 1, 4, 2, 3, 2. The average of these responses is 3. This is what I use to start fading out treats in training the 'heel'. At first, the dog is rewarded every step for staying in the 'heel' position. As the get better with staying in position in anticipation of treats, the treats are given after one step, two steps, four steps, three steps, two steps. They are getting rewarded on average every three steps, but it's not always three exactly and they are getting fewer treats than in initial training. Over time, we simply make the average a bigger number. 
  3. Random Ratio: This is the other way to build strong behaviors. In random ratio, the dog gets a reward sometimes, but not other times. It should be as random as possible. Truly random rewarding is hard for us people to wrap our heads around; we try to make patterns so it makes sense in our minds. Dogs are great at figuring out patterns, so they soon learn if we are actually making a pattern and predict it. This can be used in training the 'heel' just like the above example, but we would want to keep it random, instead of aiming for an average number of steps. 
  4. Fixed Interval: The dog gets a reward only when the behavior is offered when a set period of time has elapsed since the previous response. This is something that we don't really use much in training because it actually isn't terribly useful in most training situations. The idea is that a dog offers a behavior, like 'sit' and gets a reward. There would be a predetermined interval, lets say 4 seconds, that the dog needs to wait until it can offer the 'sit' again and get a reward. If they sit at 1, 2, or 3 seconds, they get no reward. Any 'sit' after 4 seconds gets a reward. Over time, responses on the part of the dog go up because they know they have to offer the behavior to get a reward. It's a fun thing to do, but really has little real use in day to day training. The problem is that a dog can get distracted and forget to respond with the correct behavior in that interval, so we can't effectively train anything that's well remembered.   
  5. Variable Interval: Just like variable ratio above, this is a reward for different responses, averaging a number you have picked. The difference is that this is rewarding for a period of time instead of a number of responses. The dog would get a reward for the correct behavior after a period of time has elapsed, but that interval of time will vary within an average. Like fixed interval this can result in a steady string of responses, but since the response is dependent on the animal offering it, can be tricky to use in training. 
When using a Differential Reinforcement Schedule, rewards are given after certain types of responses are offered or after certain rates of response are offered. Basically, this means that the dog gets a reward based on the quality of their response or the frequency of offering the correct response. This is what we use to fine tune behaviors, to build complex behaviors, or work with especially nervous, anxious, or reactive dogs.

 1. Response Type schedules are simply the quality of the response- a 'down' with the belly all the way on the ground is preferred over a 'down' with the belly tucked up and not touching the ground.

Within this, there are three types of schedules which we use to get the desired behavior and remove unwanted behaviors:
      a. Differential Reinforcement of Incompatible Behaviors (DRI): A dog jumps to greet people will be rewarded for any behavior that they can't do while jumping. Sitting, laying down, or simply standing would all be considered incompatible behaviors. These incompatible behaviors become more rewarding than the problem behavior (jumping).
      b. Differential Reinforcement of Other Behaviors (DRO): A dog who barks at passers-by on walks can be rewarded for doing anything that is not barking. These other behaviors become more rewarding than barking, so the barking starts to diminish. 
     c. Differential Reinforcement of Excellent Behaviors (DRE): A dog who perfectly heels on command when asked the first time, then sits in position when the handler comes to a stop would get a reward because that is an ideal response. We tend to reward these great responses a bit longer because they are the ultimate goal and we want them to become the normal. By rewarding these great behaviors, all others extinguish themselves. 

2. Response Rate Schedules are ones that require a dog to respond at a certain rate for that reward. The reward is based on the offering of the correct behavior within the correct time period. Much like fixed interval and variable interval training, these aren't of as much use in dog training, but here you go anyway. 
  • Differential Reinforcement of High Rates (DRH): A dog is only rewarded for offering the 'look' behavior if it occurs within 7 seconds of the previous response. If the dog looks at 1, 2, 3, 4, 5, 6, or 7 seconds, they get a reward. If it is 7 seconds or more they get no reward. This is used to build a steady stream of responses.
  • Differential Reinforcement of Low Rates (DRL): A dog is only rewarded for offering the 'look' behavior after a specified period of time has elapsed, lets say 7 seconds. Any look after 7 seconds gets a reward, anything before 7 seconds does not. 
A Duration Reinforcement Schedule requires the dog to respond throughout a set period of time; these periods of time can be fixed, variable, or random. The classic example for this is the 'stay' cue. A dog is asked to hold the stay position for a period of time. Initially in training, we work with a short period of time and build it up gradually to longer duration and out of sight stays.

  • Fixed Duration: The dog has to stay for 1 minute to get a reward. If they get up before that minute is up, there is no reward. 
  • Variable Duration: The dog has to stay for an average of 1 minute to get the reward. This is the best way to lengthen the duration of a stay because you are on average staying within the time period you know the dog will tolerate, but can gradually increase the duration by increasing the average.
  • Random Duration: The dog is asked to stay for random periods of time, rewarded only if they do so. This is a great way to lengthen duration also, because the dog can't predict how long you will be gone. If we simply leave for longer each time, the dog predicts that the time period will be longer, since they are good at putting together patterns. 

Still awake? Good job, you're almost done!

So what does all that mean? It means that you can fine tune and train different behaviors using different reinforcement schedules. Within this, you can even give different types of rewards based on responses (more on that another day).
There are three lessons I want you to come away with from this:
1. there is strong relationship between continuous reinforcement and degradation of behavior even before the food is faded.  If a behavior is always followed by a treat, over time the dog has no motivation to offer the behavior quickly or perfectly. If a behavior is always followed by a treat and the treats suddenly stop, the behavior stops too because the behavior is no longer paying off as it had been! Dogs who are on a continuous reinforcement schedule too long end up with sloppy or slow behaviors and behave like spoiled children, demanding things they want.
2.  Random and variable reinforcement always result in the strongest behaviors, with much lower incidents of the behavior extinguishing as rewards fade. If a behavior is always rewarded initially and then randomly or variably rewarded, there is still always the possibility of a reward, so the behavior continues with the same strength. This is how a slot machine works. The machines pay out on a variable or random schedule, though it is very difficult to predict exactly when it will. The longer you keep putting coins in, the more convinced you become that it will pay off next time.
3. It is very difficult for us humans to be truly random, which is why we tend to use variable rates of reinforcement in training. That way, your human need for some order is met and your dog is still not getting rewarded every single time, so we still get strong behaviors. 

The real point in telling you all of this, aside from giving you great reading material for your next bout of insomnia or a new drinking game (count how many times the word reinforcement is in here) is to demonstrate that the person who trains you and your dog should know a LOT about learning and training. It's not just a matter of tossing a collar on a dog and grabbing some treats- my 3 year old son can do that. It's not a matter of putting a pinch, choke, or prong collar on your dog and yanking him around to demonstrate "who is boss". Training and subsequent learning should be intentional, systematic, soundly based in science and well executed. There should be some room for flexibility with each individual dog/human pair and nobody should be pushed to the point of breaking or shutting down in training. Once you reach that point, nothing good is being taught.


Resources:
 Excel-Erated Learning; Explaining in Plain English How Dogs Learn and How Best to Teach Them by Pam Reid, pgs. 48-59

http://www.lifecircles-inc.com/Learningtheories/behaviorism/Skinner.html

http://www.educateautism.com/applied-behaviour-analysis/schedules-of-reinforcement.html