ContextualApproachestoOutcomeEvaluation
JoanC.Durrance HowLibrariesandLibrariansHelp [e-mail] UniversityofMichigan SchoolofInformation UniversityofIllinois OutcomeEvaluationandConsultingInstitute July7,2003
ThePromiseofOutcomes
Serviceproviders,governments,otherfundersandthepublicare callingforclearerevidencethattheresourcestheyexpendactually producebenefitsforpeople.IMLS Evaluationmustfocusontheeffectofaninstitution'sactivitiesand servicesonthepeopleitservesratherthanontheservices themselves(outputs).IMLS Thoseofuswhohavecommittedourlifesworktotheimprovementof librariesarecontinuallyfrustratedwithourlackofabilitytoeffectively tellthelibrarystory.Whileitwouldbemoreconvenientiftheworthof librarieswassimplyacceptedonfaithbyuniversitypresidents,county commissioners,citymanagers,andschoolboards,thatisfrequently notthecase.PeggyRudd,DirectoroftheTexasStateLibraryand ArchivesCommission,(IMLS2000)
AFewProblemsFacingTodaysLibrarians&Those WhoSeektoEvaluateOutcomes
Confusionaboutoutcomes Lackofunderstandingofoutcomeranges Inadequateassessmenttools&evaluationmodels VarietyofLibraryCulturalconcerns(includingfearof invadingprivacyWecouldntask!) Overworkedstaff Lackofskilledstaffandconsultants Staffdontknowwheretobegin Fearandunease Attemptstooversimplify(thathelpedgetuswhereweare today) Toofewgoodcandidateliststodevelopaframework
OutcomeDomainsSuggestedforaNeighborhoodDevelopmentProject FamilyStrengthening,AllianceBuilding,Advocacy,andCollectiveAction Todate,thereviewofsurveyliteraturehasidentifiedverylittlecontentofdirectrelevanceto thisdomain. ConnectiontoInformalSocialNetworks Indicatorsinthisdomainpertaintorelationshipsandinteractionsamongneighborsand families;social,linguistic,andtechnologicalisolation;participationincommunity,religious,or civicactivitiesandorganizations;relationshipsbetweenyouthandadults;andneighborhood culture. ConnectionstoFormalHelpingSystems Indicatorsinthisdomainpertaintohealth,education,childcare,childwelfare,resident relationshipstoserviceproviders,andcommunitybasedorganizations. ConnectionstoEconomicOpportunity Indicatorsinthisdomainpertaintoemployment,income,assets,debt,andfinancialservices. BuildingNeighborhoodAssets Indicatorsinthisdomainpertaintoneighborhoodeconomy,housing,amenities,nuisances, safety,politicalpower,andresidentsatisfaction. FamilyFunction Indicatorsinthisdomainpertaintoparentalcompetencies,parentingpractices,homesafety, andparentchildrelationships ChildandFamilyWellBeing Indicatorsinthisdomainpertaintochildhealth,socialadjustment,educationalachievement, andeconomicwellbeing.
AnnieE.Casey Found.
Afewcandidatelistslibraryserviceoutcomes
Afewlists: IMLS Resources AcademiclibrariesFocusoninformationliteracylearning contributions ACRLhttp://www.ala.org/acrl/sacguid.html ARLhttp://www.arl.org/stats/arlstat/jal01.html Schoolmediacentershttp://www.big6.com/ PubliclibrariesCountingonResults: http://www.lrs.org/html/about/CountingOnResults.htm How Libraries and Librarians Helphttp://www.si.umich.edu/libhelp/ Atthisstagelistsusefulforideadevelopment,but
OutcomesresultfromSPECIFICserviceactivities. LibrariansshouldavoidAPPLYINGaUNIVERSALsetofrequired outcomes.
CountingOnResultsListsandLessons
Next6slides.Seehandout. Welldocumentedstudyofpubliclibraryoutcomes. Candidate outcomes developed around hybrid PL service responses --Steffen et al. Public Libraries 2002 Study Design: Outcomesidentifiedbylibrarians Study team developed survey instruments--oversized postcards with pooled librarian developed candidate outcomes and demographic information. Outcomes tested in multiple libraries Most widely reported outcome: read for pleasure
CountingonResults Table16.GeneralInformationOutcomes: Outcomes %ofTotalRespondents
1)Readforpleasure74.0 2)Obtainedaspecificfactordocument41.8 3)Learnedmoreaboutaskill,hobby,orotherpersonalinterest55.9 4)Identifiedorcontactedanorganization15.6 5)Foundinformationforschool,work,oracommunitygroup46.2 6)Sharedaculturalexperienceorexchangedinfow/others19.4 7)Learnedmoreaboutalegal,social,orpoliticalissue23.8 8)MetnewpeoplewithwhomIsharecommoninterests22.0
CountingonResults:GENERALPUBLICLIBRARYSURVEY PostcardSurvey
Howhavethelibrarysserviceshelpedyou? Mark(X)allofthefollowingthatapply. Asaresultofmyrecentuseofthelibrary,I Readforpleasure(bestsellers,biographies,currentevents,etc.). ObtainedaspecificfactordocumentIwasinterestedin(aname,address, date,statistic,laworregulation,etc.). Learnedmoreaboutaskill,hobby,orotherpersonalinterest(howto/ consumerinformation,cooking,carrepair,genealogy,personal finance,etc.). Identifiedorcontactedanyorganization(aschool,socialclub,museum, historicalsociety,politicalparty,specialinterestgroup,etc.). Foundinformationneededforschool,workoracommunitygroup. Sharedaculturalexperienceand/orexchangedinformationwithothers (bookgroup,authorlecture,film,otherperformance,etc.) Learnedmoreaboutalegal,socialorpoliticalissue(environment,civil rights,SocialSecurity,education,militarypreparedness,etc.),or elections(local,state,ornational). MetnewpeoplewithwhomIsharecommoninterests. Otherpleasespecify: Ifyouhaveasuccessstoryaboutyouruseofthelibraryorothercomment,pleaseshareitbriefly here(pleaseprint):
Counting On Results. Table 13. Basic Literacy Outcomes: All Libraries Outcomes %ofTotalRespondents
1)Improvedreading/writing/math9.9 2)PreparedforGED6.2 3)PassedtheGED4.9 4)Preparedforthenaturalizationexam6.8 5)Becameacitizen42.0(??) 6)Readtoachildorhelpedachildchooseabook35.8 7)Helpedachilddohomeworkorimprovegrades10.5 8)Appliedforajob13.6 9)Gotajob/betterjob/raiseinpay8.6 10)Managingpersonalfinancesbetter27.2 11)Infoaboutbus,car,education,jobs,money,etc25.3 12)Participatedinacommunityactivity27.2 13)Wrotealetter/postcard/email28.4
CountingonResults:BASICLITERACY(learningtoread&write) PostcardSurvey: Howhavethelibrarysbasicliteracyserviceshelpedyou? Mark(X)allofthefollowingthatapply. Asaresultofmyrecentuseofthelibrary,I Improvedmyt reading,t writing,ort mathskills. PreparedfortheGEDtest. PassedtheGEDtest. Preparedforthenaturalization(citizenship)exam. Becameacitizen. Readtoachildorhelpedachildchooseabooktoread. Helpedachilddohomeworkorimprovegrades. Appliedforajob. Gotajob,abetterjob,oraraiseinpay. Startedmanagingmypersonalfinancesbetter. LearnedsomethingIneededtoknowaboutusingbus,buyingcar, education,healthcare,jobs,handlingmoney,insurance,orchildcare. Participatedinacommunityactivity. Wrotealetter,postcardoremailmessagetosomeone. Otherpleasespecify: Ifyouhaveasuccessstoryaboutyouruseofthelibraryorothercomment,please shareitbrieflyhere(pleaseprint):
CountingonResults Table14.BusinessandCareerInformationOutcomes: Outcomes %ofTotalRespondents
1)Explored/started/developedabusiness35.5 2)Dealtwithapersonnelissue13.6 3)Closedabusiness2.5 4)Exploredjob/careerordeterminednecessaryeducation/training27.7 5)Developedjobrelatedskills30.6 6)Learnedhowtoadvanceinjob/career14.9 7)Madecareerchangesorrelocated5.8 8)Madebetterinvestmentorretirement decisions26.0 Ifyouhaveasuccessstoryaboutyouruseofthelibraryorothercomment, pleaseshareitbrieflyhere(pleaseprint):
CountingonResults:BUSINESS&CAREERINFOOUTCOMES PostcardSurvey
Howhavethelibrarysbusinessandcareerinformationserviceshelpedyou? Mark(X)allofthefollowingthatapply. Asaresultofmyrecentuseofthelibrary,I Explorednewbusinessoptions,startedordevelopedabusiness(market research, financing,franchising,homebusiness,selfemployment, regulatoryinformation,zoning). Dealtwithapersonnelissue(hiring,training,firing). Closedabusiness(sale,merger,bankruptcy). Exploredjobsorcareers,ordeterminednecessaryeducationortraining. Developedjobrelatedskills(resumewriting,interviewing,computer,or sales skills). Learnedhowtoadvanceinjoborcareer. Madecareerchangesorrelocated. Madebetterinvestmentorretirementdecisions. Otherpleasespecify:
Ifyouhaveasuccessstoryaboutyouruseofthelibraryorothercomment, pleaseshareitbrieflyhere(pleaseprint):
SelectedOutcomes:Job&CareerInfoCenters Job related outcomes (got a job, learned about a job, made a connection with an employer)
Education/training related (preparation for a new career; enrolled in program, university, etc.)
Skill changes (learned to do something new)
Personal learning gains(learned more about themselves and their capabilities)
Personal efficacy gains (Confidence building, etc.) Made connections in the community Durrance,1993;1994
SelectedListofPLOutcomesIdentifiedby HowLibrariesandLibrariansHelp
Attitude/perceptionchanges(e.g.,negativetopositive) Increasedaccesstoinformationnoted Personalefficacy(selfesteem,confidencebuilding,achangedoutlookonlife andfutureprospects,feelingsofaccomplishmentandhope) Skilllevelsincreased(e.g.,increasedtechnologicalliteracy,languagefacility, communicationskills,socialetc.) Learninggains(e.g.,increasedinterestinlearning,activeparticipationin learning,etc.) Knowledgegains(widerange,individuallyfocused,e.g.,knowledgeofthe community,knowledgeneededtopasstheGED,etc.) Progresstowardagoal. Socialnetworks(e.g.,increasedsocialandcommunityconnections;increased socialcapital) Statuschanges(e.g.,decidetoreturntoschool,gotajob,becomeacitizen, increasedparticipationasacitizen) Decreasedtransactioncosts(Savingtime,money&energy,increased convenience)
ListsHelpUsUnderstandaPhenomenon,ButUnitedWayWarns BeCarefulwithOutcomeLists!!
UWFAQ:Whydoesn'ttheResourceNetworkcontainaninventoryof outcomes,indicators,orlogicmodelsforthetypesofprogramsUnited Waystypicallyfund? Programsthatappearfromtheoutsidetobesimilarsimilarclients,similar missions,similarservicedeliverystrategiesmayinfacthaveverydifferent outcomes. UnitedWaysandotherswhohaveworkedinoutcomemeasurementhave learnedthat,foroutcomemeasurementtobesuccessful,programsmust identifyoutcomesandindicatorsforthemselves. Thisassuresthattheyarerelevanttotheprogram'sdesignandusefulto programmanagers. Inaddition,programsreportthattheprocessofidentifyingtheiroutcomesisin itselfavaluablebenefitofoutcomemeasurement,providinggreaterclarityand focusforstaff,volunteers,andclients. And,ofcourse,weallaremorecommittedtoaneffortifwehavehelpedshape itandthusknowitsresultswillbeusefultous.
ToolkitOverview http://www.si.umich.edu/libhelp/
SelectedCaseStudiesfromHLLH
Queens Borough Public Library This case study focused on the outcomes of a variety of immigrant services of the New Americans and Adult Learner Programs. After-school community technology programs: Ourstudyofafterschool communitytechnologyprogramsindigitaldivideneighborhoodsshowthe outcomesofdifferentpubliclibraryafterschooltechnologyprogrammodels. BothincreasedcomputerandInternetskills(that'swhytheteenscome). Outcomesoftheseprogramsvariedbasedonprogramactivitiesandpolicies. WiredforYouthCenters,AustinPublicLibrarySystem FlintPublicLibraryCommunityInformationAgentsOnline(CIAO) Peninsula Library System's Community Information ProgramThe Peninsula Library System's Community Information Program provides countywide community information to local nonprofit agencies. This case study sought to reflect the outcomes of these services. We determined, in addition, that CIP fosters county wide collaboration among agencies.
AimofHLLHOutcomesToolkit
Developsetsofcandidateoutcomesgeneratedbyusers themselves Usecontextualapproachestohelplibrariansbetter understandandarticulate Theuserandtheuserinteractionfromtheuser perspective Impactsofservicemodels Showtheconnectionbetween needs&usesandoutcomes activitiesanduseroutcomes; Providelibrarianswithtoolstheycanusetoidentify outcomesrelevanttotheirownservices. Note:Locallibrarystaffshoulddeterminewhichoutcomes topursueandshouldsetowntargets.
HowLibraries&LibrariansHelp OutcomesToolkit
Four Stage Contextual Model
Preparing for Outcome-Based Evaluation Collecting Data Analyzing Data Using What You Find
KeyCharacteristicsofHLLHContextualModel
Outcomesarisefromthechangesthatresultfromtheinteraction betweenindividualsandserviceactivities;Clientelegenerate& communicateoutcomes HLLHOutcomemodelseekstohelpevaluatorsunderstandoutcomes fosteredbyfocusingon: Usercenteredcommunityfocusedpubliclibraryservices
Servicemodel Activities Staff Needs Uses Changesinclientele,others
Targetclienteleindividuals,organizations
Processseekstohelpdecisionmakersselect,analyze,synthesize,and useoutcomes
StageOne:PreparingforanOutcomeEvaluation
Selectatargetservice. Identifyafocus. Gainanunderstandingofthecontextoftheservice Worksheet#1:Determiningcontextyourserviceanditsusers Worksheet#2:Determinescope,clientele,identify activitiesthatcontributetooutcomes.Basedonexisting datasuggestpossibleoutcomes.Sketchinputs. Worksheet#3.Getorganized.Thinkthroughtheprocess.
CommentsonPreparingforanOutcomeEvaluation
InthissectionofthepresentationIwill: Identifytypesofservicesthatlendthemselvestooutcome evaluation. Provideexamplesofcontextualcomponentsofoutcome evaluation. Showwhyknowledgeoftheclienteleisessentialto anticipatingoutcomes. Showhowservicecomponents(activities)contributeto context&shapes(fostersand/orlimits)outcomes. Showhowoutcomeschangewithcontinuedcontactwith service(astrustlevels,skills,etc.grow).
DeterminingALibrarysSetofOutcomes: Whatsimportantaboutcontext?(Worksheet1)
Selfanalysis:(Questions12) Whatistheservicemodel? Whataretheservicestrengths? Whatdostaffbringtotheservice? Identifyvariousserviceactivities? Context:(Qs35) Whoneedsthisservice?Whyisitneeded(Q3) Users:Whatdostaffknowaboutusers?(Q4)) Use:Howdopeopleusetheservice(I.e.whichactivitiesdothey engagein)?(Q5) Whoarethestakeholdersoftheservice?(Stakeholdersmayhelp jumpstarttheprocess.)(Q6)
ContextualInformationaboutTeenTechParticipants
TeensinFlint&preteensinAustin(ages812)liveinpoordigital divideneighborhoods. FlintandAustinparticipantssoughtprogramtogainskillsthey perceivedtheyneeded. Flintteenswerenominatedbyschoolcounselorsasunderachievers. Madeyearlongcommitment.Receivedstipendforparticipation. Austin.Latchkeykidsoftenparticipants.Kidsoftencomeandstay (andstay).Librariansdevisenoncomputeractivitieswhilekidswaitfor computeravailability. Teenparticipationinbothprogramschangedperceptions(e.g.,about librarians),attitudes,usesoftheprogram(i.e.,growth).Thesechanges (outcomes)influencedtheattainmentofabroaderrangeofoutcomes.
TeenTechnologyProgramContextualFactors: ContributionofActivitiesandStaff
Intensiveacademicyearcomputer trainingprogram(FlintCIAO) Inputs:Multipurposecomputerlab available1afterschoolsession+1Sat AMsession;Widerangeofsoftware. Food. Model:Teenparticipationlimited:30in theprograms1styear;14inthe programs2ndyear. Activities:Intensivehandson interactivetechnologytraining.Software training.Projectlearning.Teensworked collaboratively.Communityfocused activities.Finalprojectcommunity focused.Periodiccelebrations. Instructionandsupervisedinteraction Staff:CIAOaddon.Instruction, coaching;interactionwcommunity leaders;caring;mentoring.Admiredby participants.
Dropinuseofcomputers(Austin WFY)
Inputs:Sixcomputers/branchdevoted solelytokiduse;Spacedevotedsolely toWFYactivities;Adjacenttohomework center. Food. Model:Computertimelimited.First come.Firstserved.Afterschoolrushto getfirst30minuteslotorsignupfor waitlist. Activities:Maintaininformal environment;welcomedropinsafter school;triage;handsoninstructionas needed;kidsencouragedtowork together;emailassistance.To accommodatelargenumbersofkids,30 minutelimitmaintained.Staffdeveloped waitingactivities. Staff:WFYdesignatedlibrarian. Instruction;mentoring;caring.Admired byparticipants.
ContextualFactorsAssociatedwithImmigrants Immigrantsmaywantto: Gainlanguagefacilityformultiplepurposes(job, communicatewithteachers,medicalpersonnel,etc.) Maintaintheirownlanguageandpassontotheirchildren Getaroundinastrangelandandcommunity Gethelpgettingconnectedtoacommunityservicefora familymemberorself Strengthenfamily Getajob Solveaneighborhoodproblem Becomeacitizen Maintainculturalheritage BecomemoreAmerican
StageTwo:CollectingDataThatWillProvideCandidate Outcomes
Stage2introducesdatacollectionmethodsincluding: Focusgroups Observation Interviews Collectinganecdotaldata(stories,comments,etc.) Surveys InstrumentdevelopmentSampleinstrumentsincludedwith caveats. Datacollectionapproaches&methodsshapethedata. Datacollectionapproachesshouldbeculturally appropriate.
StageTwo:DataCollectionComments
InthissectionIwill:
Discussdatacollectionapproaches Recommendusingmultiplemethods Suggeststartingwithexistinganecdotalinformation Identifythekindsofopenendedquestionsthatprovide dataaboutuseandusers CautionthatduringDataCollectionresearchersneedtobe alerttoidentifyUnanticipatedOutcomes Includeexamplesofhowthiskindofstudyidentifiesboth ANTICIPATEDandUNANTICIPATEDoutcomes.
DataCollectionApproaches. SelectedCaseStudies
Prior to the site visit to Queens, the research team interviewed project staff by telephone and carefully examined the program model using the Queens website and other materials. During the site visit, researchers observed at multiple NAP sites, conducted interviews and focus groups with program staff and collaborators, collected resource materials and anecdotal information. Interviews with users of New Americans Program and Adult Learner Program were conducted by library staff often in the language of the customer. Follow-up interviews conducted in-person and by telephone to assess the efficacy of the research instrument used by library staff in their interviews with customers. TheFlintandAustinstudiesusedfocusgroupswithyouthparticipants,librarians, indepthinterviewswithlibraryandprojectadministrators,andinterviewswith localnonprofits.Seeaboveforprevisit. PeninsulaLibrarySystemTodeterminetheimpactofacommunityinformation database,wefirstconductedfocusgroupsofnonprofitagencyadministrators whousedthedatabaseandfollowuptelephoneinterviewswithusersof specificaspectsoftheservice.Seeaboveforprevisit.
OpenEndedQuestionsAimedatDetermining Outcomes
Developquestionsthat: Focusontheuserscontext(needs;motivationsforparticipating, knowledge,etc.) focusontheuseoftheservice(withfocusonactivities) Identifyoutcomesoftheprogram;impactsonparticipantsand others.Questionshereshouldrelatespecificallytotheparticipants responsetooneormoreaspectsoftheprogram(program activities). Anticipatebothexpectedoutcomesandunexpectedoutcomes. Samplequestions(forspecificsituations)includedonwebsite.
http://www.si.umich.edu/libhelp/toolkit/collectOpenEndedQs.html
ExpectedOutcome:WFYTechnologySkillBuilding Components
Austin.WFY Outcomes:Gaining Techskills WFYActivitiesthatfoster Technicalskilldevelopment WFYInputsTechSkill Development
Learntousea computerforgames, homework, communication Knowhowtoreboot thecomputer Learnaboutvarious usefulandinteresting websites Learntouseselected softwareproducts
DropInComputersignup Handsoninstruction Olderparticipants encouragedtohelp youngerones Homeworkhelpavailable Participantsare encouragedtowork together
Computersdedicated forchildrensuseonly Softwareincluding: webbrowser,games; somewebsite developmenttools, Staffwithtechnical& instructionalskills Studentsunableto savetheirwork
PossibleUnanticipatedOutcome:AustinsWFYProgramas SafePlaceforPreteens(Therearemanymoresee report)
Outcome:Safe,
WelcomingPlace
ActivitiesthatfosterSafe,
WelcomingPlace
InputsthatfosterSafe,
WelcomingPlace
Kidsperceivethatthe libraryisasafe, welcomingplacefor children Childrenspendtimeat thelibraryratherthanin lessdesirableplacesor moredangerous pursuits
Promotinglibraryasa welcomingplacefor neighborhoodchildren <immigrants> Informalenvironment Astaffmemberis assignedtotriage childrencomingthrough thedoorintovarious programs,areas
InvitingLibraryBuilding inneighborhood Visiblecomputers Welcoming,friendly staff Brancheslocatednear schools,dropincenters
FlintAnticipatedOutcome:TechnicalSkills
Outcomes:Gainingtechnicalskills
Activitiesthatfostertechnicalskill
development
including: Abilitytouseacomputer Skillinusingselectedsoftwareproducts EvaluatethequalityofInternet resources Websitdevelopment Abilitytouseadigitalcamera Usesoftwaretocreateowndigitalart Abilitytousescanner;importscanned imagesintowebpage. Gainskillinusingsoftwareprograms thatbecamebasisforinfoexchange amongparticipants
Participantsgaintechnicalskills,
5hours/weekhandsoninstructionbystaff (afterschoolandSatAM) Followacreativeanddetailedcurriculum Encourageparticipantstousetechnology toexpressthemselves&communicate Emphasizeprojectbasedlearningas basisforwebsitedevelopment Incorporatehumor Creategamestoteachtechnology concepts Mentoringbyexperiencedteens
Flint:PossibleUnanticipatedOutcomeCategory BroadenedSocialNetworks
Outcome
Youthformtrustingrelationships withadults Teensseevalueofaccessing networksofthelibrariansinthe community Participantsrecognizethatthey caninteractwithleadersof communityorganizations Teenspersonalnetworks strengthened Increasedsocialcapital
Activities Webprojectaimedatselectedlocal organization Librariansbringincommunity partnersfromrelevant communityorganizations Librariansfosterinteractionwith communityorganizationstaff Teenstaughttointerview communityorganizations& conductinformationalinterviews Teenorgpartnershipcreated
Queens.ImmigrantContext
41.1% of the Queens population claim birth outside the United States, More than half of Queens residents speak a language other than English; 14% say they do not speak English well. Queens residents speak more than 100 languages. Some residents are illegal aliens and fear recognition. Skill levels vary from those who come from oral tradition cultures to those who speak and read several languages and hold advance degrees. As seen above, immigrant needs vary considerably.
QueensPublicLibraryNewAmericansProgram SelectedProgramActivitiesAsContextualFactors
Services for non-English speaking users are provided primarily through the Adult Learner Program (which includes ESOL and Literacy) and the New Americans Program (NAP), both of which are in the Programs & Services Department. Services and materials are provided in multiple languages. Staff in aggregate are multi-lingual. Activities include: thousands of public programs/year on multiple topics (cultural programs, etc.); ESOL classes at various levels; tutoring; conversation groups; workshops on coping skills of various sorts), collaboration with community organizations. Extensive marketing using ethnic media.
ExpectedOutcomeAreaImprovedlanguagefacility Outcome
ImmigrantsimprovetheirEnglish languagecommunicationskills throughliteracyandESOL programstailoredtomeettheir needs.
ACTIVITIESThatSupport Fairandregularregistration Classestailoredtomeetstudent needsatbasic,beginning, intermediateandadvancedlevels PersonalizedattentionatAdult LearningCenters ESOLselfpacedsoftware programs Multimedia,Englishlanguage collectiondevelopmenttosupport ESOLandliteracycurricula Lowtutor/teacherstudentratio Conversationgroups
PossibleUnanticipatedOutcomes: QueensNewAmericansProgram
Immigrants:
Learntoexploitanimportantcommunityresource(the library) Buildsocialnetworks Experiencepersonalgains(increasedselfconfidence,etc.) Gaintechnologyskills Makegainsfortheirfamilies Becomebetterpreparedforemployment Obtainemployment Etc.
StageThree:AnalyzingOutcomeData(Displaying Patterns)
http://www.si.umich.edu/libhelp/toolkit/analyze.html Becomeveryfamiliarwiththedata. Readthroughdataandidentifythemes(typesof outcomes). Assignpreliminarycodesandbegintogroupdata. Codebooksarentwritteninstone. Continuetocodeandanalyzedata.Lookforpatterns. Firmupdata. Capturethefindings(werecommendtablesthatinclude activities,outcomes,andsupportingdatathishelpsshow connections). Arrangeoutcomesthemselvesinpatterns.Maydevelop relevantgraphics. Developadatabaseofoutcomesandactivities. Determinethoseoutcomesthatstaffwillmonitorovertime.
Stage3Comments:LookingforEmergingOutcome Patterns
InthissectionIwill:
Showgroupedoutcomesfromdifferenttypesofservices Indicatewherepatternsarepresented Reinforcethatunderstandingpatternsrequiresathorough groundingintheservicecontextualfactors Provideexamplesofrawdatathatneedstobecoded(and thatmaybeplacedinmorethanonecategory) Illustrateprogressionofoutcomes.
GroupedOutcomesfromDifferentTypesofCommunity FocusedServices Detail available on Toolkit. Tables of Outcomes and Activities (and supporting data) for: Queens, Austin, Flint, Peninsula Outcome Reports: Public Library After-School Community Technology Programs Austin, TX and Flint, MI
http://www.si.umich.edu/libhelp/toolkit/collectCombinedFARe http://www.si.umich.edu/libhelp/toolkit/FlintReport.html The Peninsula Library System's Community Information Program http://www.si.umich.edu/libhelp/toolkit/PLSreport.html Queens Public Library http://www.si.umich.edu/libhelp/toolkit/QueensReport.html
AfterSchoolTechnologyCenterOutcomeCategories
Rangeoftechnologyskillsgains Perceptionchangesrelibrarians Communicationgains Socialskills Personalgains(senseofselfconfidence,responsibility, etc.) Activelearninggains Increasedcommunityknowledge Broadenedworldview Increasedcivicengagement Broadenedsocialnetworks Increasedsocialcapital Familygains
SelectedFlintQuotesforCoding
"Iwasinterestedincomputerstobeginwith.So,learninghowtoworkwith webpagesandworkontheInternetandthenworkingwiththedifferent communityorganizations,ithashelpedmenotjustwiththecomputers, butithashelpedmegetinvolvedmorethanIwasinmycommunity. AndnowIcanhonestlysay,oh,Ihavedonethis,orIhavecreated webpages.Well,I'vehelpedtheneighborhoodroundtablecreatetheir website,youknow,bydoingwhatIlearned.Beforethesummer sessionIhadneverheardofUrbanGardensandthatisacommunity ...