Reinforcement and extinction lab report PDF

Preview

Summary

lab report on Reinforcement and extinction ...

Description

1 RUNNING HEAD: REINFORCEMENT AND EXTINCTION

Effe c t so fRe i n f o r c e me n ta n dEx t i n c t i o ni nSn i ffyt heRa t Learning Laboratory

-

Effe c t so fRe i n f o r c e me n ta n dEx t i n c t i o ni nSn i ffyt heRa t

2 REINFORCEMENT AND EXTINCTION Millions of adults go to work every day and consequently receive paychecks. The pay checks serve as motivation to go to work each day. This is one of the many ways in which operant conditioning applies to everyday life. Operant conditioning refers to a type of learning that involves the use of a reinforcing or punishing stimulus after a particular behavior has occurred. Both reinforcement and punishment can be positive or negative. Positive refers to addition of a stimulus, while negative refers to removal of a stimulus. Reinforcement is an increase in a target behavior, while punishment is a decrease in a target behavior. There are two types of reinforcers: primary and secondary reinforcers. Primary reinforcers, such as food, are unconditioned reinforcers which are innately reinforcing and do not require special training or conditioning with other reinforcers unlike secondary reinforcers. Secondary reinforcers, such as money, become reinforcing when they are associated with other reinforcers. The timing of the presentation of reinforcers has an impact on an organism. For example, Urcelay & Jonkman (2019) studied the ways in which delayed rewards aid in forming habits. In order to investigate this concept, the researchers used rats to conduct two experiments in which they observed the relationship between “goal- directed” behaviors and response outcomes (Urcelay & Jonkman, 2019). They found that rats exhibited “goal- directed behavior” following fixed reinforcement training when presented immediately with the reinforcer following their performance of the desired behavior as opposed to being rewarded twenty seconds later. Schedules of reinforcement describe the delivery of reinforcers for behaviors and can impact a participant’s performance. Edwards, La Londe, Cox, Weetjens, and Poling (2016) studied how giant pouched rats could be used locate people in collapsed dwellings and these rats could be commanded to return a “release point”. The researchers investigated these concepts by having several male and female rats locate targets, people sitting in collapsed dwellings, while

3 REINFORCEMENT AND EXTINCTION varying reinforcement: no reinforcement, variable ratio reinforcement schedules, and continuous reinforcement schedules. They found that rats took the less time to performed the target behavior, locating targets, when they were on a continuous or variable schedule of reinforcement than when they were not provided reinforcement (i.e. not on a schedule of reinforcement). Additionally, they found no significant difference between the variable ratio and continuous reinforcement schedules. This led the researchers to conclude that the schedules of reinforcement influenced the rats’ performance. Reinforcement schedules reinforce some occurrences of the target behavior, whereas continuous reinforcement schedules reinforce all occurrences of the target behavior. Interval schedules provide reinforcement after the first response following a particular interval of time. On the other hand, ratio reinforcement schedules provide reinforcement following a certain number of responses. Fixed reinforcement schedules deliver the reinforcer following a response after a fixed amount of responses or time. Contrarily, variable ratio reinforcement schedules deliver a reinforcer after an average number or responses or time. Researchers often compare different types of reinforcement schedules in order to determine their effectiveness. Cohen, Richardson, Klebez, Febbo, and Tucker (2001), as part of a study focusing on using biofeedback to increase forearm- muscle tension, compared the effectiveness of continuous reinforcement, variable interval, fixed interval, variable ratio, and fixed ratio reinforcement schedules when the muscle tension of college students increased above a “high threshold”. The experimental procedure consisted of three feedback sessions a day for three consecutive days. The last daily feedback sessions were immediately followed by a session with no feedback. Fixed ratio schedules produced the highest response rates, variable ratio schedules produced the second highest response rates, and continuous reinforcement ratios

4 REINFORCEMENT AND EXTINCTION produced the lowest response rates. This indicated that fixed ratio schedules were most effective in increasing the target behavior. In an effort to replicate past research conducted on real life rats, the researcher conducted the following study using a virtual rat computer program. The researcher hypothesized that small variable ratio schedules would predict steady bar presses with long pauses, while large variable ratio schedules would predict rapid and fairly steady response patterns. Similarly, she hypothesized that large interval schedules would predict slow and fairly steady response patterns. In regard to fixed ratio schedules, the researcher predicted that response rates remain high until reinforcement had been received. Furthermore, she predicted that receipt of the reinforcement would be followed by pauses in responding, and that as the size of the larger fixed ratio schedule increased, the pause following each reinforcement would become longer. She hypothesized that large fixed interval schedules would predict slow response patterns, and that there would be a pause following reinforcement followed by an accelerating rate which would continue until the next reinforcement was delivered. Also, she hypothesized that the magnitude of the fixed interval schedule would be directly proportional to the magnitude of the pauses. Lastly, the researcher hypothesized that extinction would occur faster in continuous reinforcement than in partial reinforcement. Me t ho ds Par t i c i pa nt s Thes a mpl ec on s i s t e do f5v i r t ua l ,ma l ea l b i n oSp r a gue -Da wl e yr a t sa l lo fwh om we r e n a me dSni ffy( N=5 ) .There was one rat for each type of schedule as well as for extinction: variable ratio schedules, fixed ratio schedules, variable interval schedules and extinction after partial reinforcement (VI- 30), fixed interval

5 REINFORCEMENT AND EXTINCTION schedules, and extinction after continuous reinforcement. The rats were previously conditioned via magazine training to associate the sound of the magazine with food and were also shaped to press the bar. Ma t e r i a l s The program Sniffy the Virtual Rat Pro Version 3.0, a computer program, was used to perform each of the experiments (Alloway, Wilson, & Graham, 2012). Sniffy the Virtual Rat Pro uses previously collected data from experiments done with live rats in laboratories in order to simulate Sniffy’s behavior. Sniffy is always inside a virtual operant chamber. Researchers use this program to run both classical and operant conditioning experiments. Sniffy the Virtual Rat Pro keeps a record of the data and provides the data corresponding to the experiment(s) performed. The program gives researchers the option to have bar graphs illustrating the data behind Sniffy’s actions, appear on the computer screen. Information regarding Sniffy the Virtual Rat Pro was obtained from the in class slides. Procedure Each of the exercises in this experiment related to operant conditioning. The researcher maintained cumulative records for the exercises. The researcher changed the schedule of reinforcement in each exercise of the experiment. The first exercise, titled ‘Exercise 32’, focused on using small variable ratio schedules to predict steady bar presses with no long pauses. A VR5 schedule was used, meaning that on average

6 REINFORCEMENT AND EXTINCTION Sniffy had to make 5 bar presses in order to receive reinforcement. The researcher pressed the bar in a fast and steady manner with no long pauses. Thes e c onde x e r c i s e ,t i t l e d‘ Ex e r c i s e3 3’ , f o c us e donu s i n gl a r g ev a r i a bl er a t i os c he du l e c o ns i s t i n gof10ba rp r e s s e s . Th eb a rp r e s s e swe r ei nc r e a s e di ni nt e r v a l so ffiv eun t i lt h ev a r i a bl e r a t i or e i n f or c e me ntr e a c h e d3 0ba rp r e s s e s ,t husat ot a lo ffiv ed i ffe r e ntv a r i a bl er a t i os c h e dul e s we r eus e ddu r i n g‘ Ex e r c i s e3 3’ . Th i sme a ntt her e s e a r c h e rwe ntf r o mde l i v e r i n gt her e i nf or c e r a f t e ra na v e r a g eof5r e s pons e st od e l i v e r i n ga f t e ra na v e r a g eof30r e s p on s e s . Ex e r c i s et hr e e ,t i t l e d‘ Ex e r c i s e35 ’ ,f o c u s e donus i n gafix e dr a t i os c h e dul ec o ns i s t i n gof5 b a rpr e s s e swhi c hwe r ei n c r e a s e di ni nt e r v a l soffiv eu nt i lt h efix e dr a t i os c h e dul eof r e i nf or c e me ntha dr e a c he d50ba rpr e s s e s .Thi sme a ntat o t a loft e ndi ffe r e ntv a r i a bl er a t i o s c he d ul e swe r eu s e dd ur i n gt hee x e r c i s e . Sma l lfix e dr a t i os c he du l e swe r eus e di nt hei n t e r v a l s r e q ui r i n g5,1 0,a n d15ba rp r e s s e s .La r g efix e dr a t i os c he du l e swe r eus e di nt hei nt e r v a l s r e q ui r i n g20ormor eba rpr e s s e s . Th er e s e a r c he rwe ntf r o mde l i v e r i n gt her e i nf or c e ra f t e rt hefif t h r e s p ons et od e l i v e r i n gi ta f t e rt hefif t i e t hr e s p ons e . ‘ Ex e r c i s e3 4’ ,t hef o u r t he x e r c i s e , f o c u s e do nv a r i a bl ei nt e r v a ls c he d ul e s .Ther e s e a r c h e r d e l i v e r e dt h er e i nf or c e ra f t e rt hefir s tr e s p ons e . Thefir s ti nt e r v a lc on s i s t e do fav a r i a bl ei nt e r v a l s c he d ul eof5s e c ond s . Thel e n gt hoft i mewa si nc r e a s e di ni n t e r v a l so f1 0s e c ond su nt i lt he r e s e a r c he rr e a c he da30s e c o nds c h e dul e . Ther e s e a r c he rwe ntf r o m,o na v e r a g e ,d e l i v e r i n gt he r e i nf or c e r ,a f t e ra5s e c o ndi n t e r v a lt ode l i v e r i n gi ta f t e ra30s e c on di nt e r v a l ,ona v e r a g e . Ex e r c i s efiv e ,t i t l e d‘ Ex e r c i s e36 ’ ,f o c u s e do nfix e di nt e r v a ls c he du l e s .Ther e s e a r c he r d e l i v e r e dt h er e i nf or c e ra f t e rt hefir s tr e s p ons e .I n t e r v a lon ewa s5s e c o nd sl on g .Thel e n gt ho f t i mewa si nc r e a s e di n1 0s e c on di nt e r v a l su nt i lt h er e s e a r c he rr e a c he da3 0s e c o ndi nt e r v a l . Th e

7 REINFORCEMENT AND EXTINCTION r e s e a r c he rwe n tf r o m,de l i v e r i n gt her e i n f o r c e rf o l l o wi n ga5s e c ondi nt e r v a lt ode l i v e r i n gi ta f t e r a30s e c on di n t e r v a l ,o na v e r a g e . Then e xte x e r c i s e ,‘ Ex e r c i s e25’ ,f oc us e done xt i nc t i onofc ont i n uou sr e i n f o r c e me n t s c he d ul e s .Thi si n v ol v e de xt i n c t i o no ft hepr i ma r yr e i n f or c e r ,f o od,a n ds e c onda r yr e i n f o r c e r ,t h e s o undo ft hema g a z i n e . Dur i n gt hee x e r c i s et h er e s e a r c he rdi dnotg i v eSni ffyf oodn ordi ds h e e xpos ehi mt ot hes o undoft h ema g a z i ne .Sni ffywa si s ol a t e du nt i lt h er e s e a r c he rr e a c he da r e s p ons er a t eo f0 . 4 0t i mepe rmi n ut eorl o we r . ‘ Ex e r c i s e3 7’ ,t hel a s te x e r c i s e ,wa si d e nt i c a lt o ‘ Ex c i s e2 5’wi t honee x c e p t i on:‘ Ex e r c i s e3 7’i n v ol v e de xt i nc t i onoffix e di nt e r v a ls c h e dul e sa s o ppo s e dt oc o nt i nu ousr e i n f or c e me nts c he d ul e s .Wec a l c u l a t e ds e pa r a t e l yt h ea mo unto ft i mei t t o okt oe xt i nc tt h ec o nt i nu ousr e i nf or c e me nta n dt hev a r i a bl er e i nf or c e me n ts c he dul e s . Af t e r d oi n gs o ,t h er e s e a r c he rs ha r e dhe rda t awi t hh e rf e l l o wr e s e a r c he r sa ndc a l c u l a t e ds e pa r a t e l ya c l a s sa v e r a g ee a c ho ft het y pe so fe xt i nc t i on. Ther e s e a r c he rus e dt h ef ol l o wi n gc onc e p t si nor d e rt or e a de a c hc umul a t i v egr a ph. The h or i z ont a ll i nec ont i n ue da st i mee l a ps e d .Ab umpi nt hes l o peoc c ur r e de a c ht i meSn i ffypr e s s e d t heb a r .As t r a i ghtl i nei n di c a t e dt ha tSn i ffydi dnotpr e s st h eba r . Thev e r t i c a ll i ne swhi c h a l t e r na t e db e t we e nda s h e da ndwe dg e d,r e pr e s e n t e d5mi nut ei nt e r v a l s .Ba c ks l a s he s( \ )d r a wn a c r o s sma n yoft hel i ne sr e p r e s e nt e dat i mewhe nSni ffywa sg i v e nr e i nf or c e me nt .Thes l opeof t her i s i n gl i n e si ndi c a t e dt hes p e e do fr e s p ons e . Al s o ,t h e r ewe r ea l wa y s75r e s p ons e sb e t we e n t wop e ndr o ps . Re s ul t s Att h eb e g i n ni n gof‘ Ex e r c i s e32’ ,t h eb a r -s o unda s s o c i a t i ona nda c t i o ns t r e n gt h d e c r e a s e d .Onc eSn i ffyh a dr e c e i v e ds e v e r a lr e i n f or c e me nt so nt hene ws c h e dul e ,t h eba r -s ou nd

8 REINFORCEMENT AND EXTINCTION a s s o c i a t i ona nda c t i o ns t r e n gt hi nc r e a s e d. Thi sc o ul dbes e e nb yt h ef a c tt ha ti tt oo kSni ffyl o n g e r t or e s p ondf ort h efir s ts e v e nt yfiv er e s p ons e so fVR5t h a nt hes e c onds e tofs e v e n t yfiv e r e s p ons e so fVR5a sde pi c t e di nfig ur eon e .Ov e r a l l , t hes ma l lv a r i a bl er a t i os c h e dul e su s e di n ‘ Ex e r c i s e 32’s ho we df a s ta nds t e a d yba rp r e s s e swi t hnol on gpa u s e s . Thel a r g ev a r i a bl er a t i os c h e dul eus e di n‘ Ex e r c i s e33 ’s h o we dar a pi da ndf a i r l ys t e a d y r e s p ons epa t t e r n .I nt h eb e g i n ni n gof‘ Ex e r c i s e33’ ,t h eba rs oun da s s o c i a t i o nwe a k e n e d,b utwe nt b a c kupa g a i no nc eSni ffyh a dr e c e i v e ds e v e r a lr e i nf or c e me nt so nt hene ws c he d ul e .Th i swa s e vi de nc e db yt hef a c tt ha ti tt ookSn i ffyl o n g e rt or e s p on df o rt hefir s ts e v e n t yfiv er e s p ons e sof VR3 0t ha nf o rt h es e c o nds e tofs e v e nt yfiv er e s p ons e so fVR30a sde pi c t e di nfigur et h r e e . Al lo ft hel a r g efix e dr a t i os c he dul e sus e di n‘ Ex e r c i s e35’s ho we dhi ghr e s pon s er a t e s u nt i lr e i n f o r c e me n tha dbe e nr e c e i v e d .Re c e i ptofr e i n f o r c e me ntwa sf ol l o we db yp a us e si n r e s p ond i n g . Ast h er e s e a r c h e ri nc r e a s e dt hes i z eoft h el a r g efix e dr a t i os c he dul e ,t h ep a us e f ol l o wi n ge a c hr e i nf or c e me n tbe c a mel on g e r .Fo re xa mp l e , t he r ei sagr e a t e rl a c kofbu mpsi n figur es i xt ha ni nfig ur efiv et husi ndi c a t i n gt ha tt h ep a us ei nr e s p ond i n gi sl o n g e ri nFR3 0t h a ni n FR15.Thes ma l lfix e dr a t i os c h e dul e spr od uc e df a s ta n ds t e a d yr e s pons e s . Thel a r g ev a r i a bl ei nt e r v a ls c he du l e su s e di n‘ Ex e r c i s e3 4’s h o we das l o wa ndf a i r l y s t e a d yr e s p on s epa t t e r n.Thi swa se vi de n c e db yt h ef a c tt h a tSni ffyt ookmor et i met or e s p ondt o t hel a s ts e v e nt yfiv er e s p on s e so fVI 30t ha nt h el a s ts e v e nt yfiv er e s p ons e sofVI 5a sd e pi c t e di n figur e sni n ea n de i gh t , r e s pe c t i v e l y .Si mi l a r l y ,t h er e s ul t soft hel a r g efix e di n t e r v a ls c he d ul e sus e d i n‘ Ex e r c i s e36’s h o we das l o wr e s p on s epa t t e r n.Th er e s ul t sof‘ Ex e r c i s e3 6’a l s oi nc l ude da p a us ea f t e rr e i nf or c e me n t , f o l l o we db yar a t ewh i c ha c c e l e r a t e du nt i lt hene x tr e i nf or c e me nt .As t hema gni t udeofe a c hfix e di nt e r v a ls c he du l ei n c r e a s e d,t hema gni t udeoft hepa u s e si n c r e a s e d.

9 REINFORCEMENT AND EXTINCTION Ther e s e a r c he r ’ sc l a s sob t a i n e da na v e r a g eof63. 125s e c ond sf o rt hee xt i nc t i onof c o nt i nu ousr e i nf or c e me nt , t h ef oc usof‘ Ex e r c i s e2 5’ . Addi t i ona l l y ,t h e yob t a i n e da na v e r a g eo f 1 08. 125s e c o nd sf ort h ee x t i nc t i o nofv a r i a b l ei nt e r v a lt hi r t y ,t hef o c u so f‘ Ex e r c i s e3 7’ . Co ns e q u e nt l y ,t h er e s e a r c he rr e a l i z e dt ha te xt i n c t i onoc c ur r e ds i g ni fic a nt l yq ui c k e ri nc ont i n uous r e i nf or c e me ntt h a ni npa r t i a lr e i nf or c e me nt .

Re f e r e nc e s Cohen, S.L., Richardson, J., Klebez, J., Febbo, S., & Tucker, D. (2001). EMG Biofeedback: The Effects of CRF, FR, FI, and VI Schedules of Reinforcement on the Acquisition and Extinction of Increases in Forearm Muscle Tension. Applied Psychophysiology and Biofeedback, 26(3), 179. https://doiorg.avoserv2.library.fordham.edu/10.1023/a:101132551968 Edwards, T.L., La Londe, K.B., Cox, C., Weetjens, B., & Poling, A. (2016). Effects of schedules of reinforcement on pouched rats’ performance in urban search-and-rescue training. Journal of applied behavior analysis, 49(1), 199-204. Graham, J., Alloway, T., & Wilson, G. (2012). Sniffy: The virtual rat: Version 3.0. Belmont, CA: Wadsworth, Cengage Learning Learning Lab. (2019, September). In class slides. Urcelay, G.P., & Jonkman, S. (2019). Delayed rewards facilitate habit formation. Journal of Experimental Psychology: Animal Learning and Cognition, 45(4), 413- 421. https://doiorg.avoserv2.library.fordham.edu/10.037/xan0000221

10 REINFORCEMENT AND EXTINCTION

Table 1 Time to Extinction Average CR Average VI-30 Extinction Time 63.125 108.125 Note: The table shows the average time it took for continuous reinforcement schedules and variable interval 30 reinforcement schedule to become extinct.

11 REINFORCEMENT AND EXTINCTION

Fi gur e1. Sma l lv a r i a bl er a t i os c he d ul e .Th egr a p hde pi c t st her e i nf or c e rb e i n gd e l i v e r e da f t e ra n a v e r a g eo ffiv er e s p ons e s( ba rpr e s s e s ) .

12 REINFORCEMENT AND EXTINCTION

Fi gur e2. Me di um v a r i a bl er a t i os c he d ul e .Thegr a phd e pi c t st her e i n f o r c e rb e i n gde l i v e r e da f t e r a na v e r a g eoffif t e e nr e s p ons e s( b a rp r e s s e s ) .

13 REINFORCEMENT AND EXTINCTION

Fi gur e3. La r g ev a r i a b l er a t i os c he d ul e .Theg r a phd e pi c t st her e i nf or c e rbe i n gd e l i v e r e da f t e ra n a v e r a g eo ft hi r t yr e s p on s e s( ba rp r e s s e s ) .

14 REINFORCEMENT AND EXTINCTION

Fi gur e4. Sma l lfix e dr a t i os c he dul e .Thegr a p hde pi c t st her e i n f o r c e rb e i n gde l i v e r e da f t e rfiv e r e s p ons e s( b a rpr e s s e s )

15 REINFORCEMENT AND EXTINCTION

Fi gur e5. Me di um fix e dr a t i os c h e dul e .Th egr a p hde pi c t st her e i nf or c e rb e i n gde l i v e r e da f t e r fif t e e nr e s pon s e s( b a rp r e s s e s ) .

16 REINFORCEMENT AND EXTINCTION

Fi gur e6. La r g efix e dr a t i os c he dul e .Thegr a phde p i c t st her e i n f o r c e rbe i n gd e l i v e r e da f t e rt hi r t y r e s p ons e s( b a rpr e s s e s )

17 REINFORCEMENT AND EXTINCTION

Fi gur e7. Sma l lv a r i a bl ei nt e r v a ls c he du l e .Th egr a p hd e pi c t st h er e i n f o r c e rb e i n gde l i v e r e da f t e r t hefir s tr e s pons ef ol l o wi n g ,o na v e r a g e , afiv es e c ondi nt e r v a l .

18 REINFORCEMENT AND EXTINCTION

Fi gur e8. Me di um v a r i a bl ei nt e r v a ls c h e dul e . Theg r a phde pi c t st her e i n f or c e rbe i n gde l i v e r e d a f t e rt h efir s tr e s pons ef ol l o wi n g ,o na v e r a g e , afif t e e ns e c ondi nt e r v a l .

19 REINFORCEMENT AND EXTINCTION

Fi gur e9. La r g ev a r i a b l ei n t e r v a ls c h e dul e .Thegr a phde pi c t st her e i nf or c e rb e i n gd e l i v e r e da f t e r t hefir s tr e s pons ef ol l o wi n g ,o na v e r a g e , at hi r t ys e c on di nt e r v a l .

20 REINFORCEMENT AND EXTINCTION

Fi gur e10 .Sma l lfix e di nt e r v a ls c he d ul e .Th egr a p hd e pi c t st h er e i n...