NIFL-ASSESSMENT 2004: [NIFL-ASSESSMENT:488] RE: some definitions

Archived Content Disclaimer

Please note: This page contains archived content from the lincs.ed.gov e-mail discussion list system, which was disabled in 2012. The content on this page is available for archival purposes only. Hyperlinks on this page may be broken or may no longer link to the content specified from within the archive posting. In addition, information displayed on this page may no longer be relevant.
From: Marie Cora (mariecora@hotmail.com)
Date: Thu Apr 08 2004 - 14:38:32 EDT
Next message: Jeri Levesque: "[NIFL-ASSESSMENT:489] RE: some definitions"
Previous message: Eileen Eckert: "[NIFL-ASSESSMENT:487] RE: assessing soft skills"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Date: Thu, 8 Apr 2004 14:38:32 -0400 (EDT)
Message-Id: <BAY17-F13A7Ix8qZnlh00056941@hotmail.com>
Errors-To: listowner@literacy.nifl.gov
Reply-To: nifl-assessment@literacy.nifl.gov
Originator: nifl-assessment@literacy.nifl.gov
Sender: nifl-assessment@literacy.nifl.gov
Precedence: bulk
From: "Marie Cora" <mariecora@hotmail.com>
To: Multiple recipients of list <nifl-assessment@literacy.nifl.gov>
Subject: [NIFL-ASSESSMENT:488] RE: some definitions
Content-Type: text/plain; format=flowed
Status: O
Content-Length: 13423
Lines: 222

Hi everyone,

Jeri noted in her posting that:

One example
>is the Even Start program that is in danger of being zero budgeted because 
>while it consistently produced outputs it did not produced enough outcomes 
>to suit the administration.

and it made me think that you might want some info on terms here - 
specifically outputs versus outcomes.  There are other related terms as 
well:  Inputs comes to mind.

I went to the handy-dandy Glossary of Useful Assessment Terms 
(http://www.sabes.org/assessment/glossary.htm) and only found a definition 
for outcomes - although I have seen definitions for the other terms.  Here's 
what I found for Outcomes:

"Changes in learners, such as learning gains in reading and writing, 
promotions at work, or increased self-confidence that occur as a direct 
result of their participation in adult literacy education; knowledge, 
attitudes, skills, etc., that the student or learner acquires as a result of 
a learning experience."

Anyone provide us with the definitions or a resource that defines the other 
related terms:  inputs, outputs, are there others?

thanks,
marie cora
NIFL Assessment List Moderator


>From: Jeri Levesque <levesqjr@webster.edu>
>Reply-To: nifl-assessment@nifl.gov
>To: Multiple recipients of list <nifl-assessment@literacy.nifl.gov>
>Subject: [NIFL-ASSESSMENT:479] 400+
>Date: Wed, 7 Apr 2004 18:11:50 -0400 (EDT)
>
>  Laura,
>
>I am an evaluator evaluation coordinator for Missouri's state literacy 
>resource center and local Even Start family literacy programs. I also teach 
>evaluation at the graduate level. I'm answering Jane's call to respond to 
>your posting.
>
>The current GPRA direction is aimed at performance outcomes and program 
>impacts.  The model currently in vogue is the logic model.  Your concern 
>about putting things in writing is valid, because federal programs that 
>can't demonstrate measured outcomes, as opposed to program activity 
>(outcomes) are in jeopardy. One example is the Even Start program that is 
>in danger of being zero budgeted because while it consistently produced 
>outputs it did not produced enough outcomes to suit the administration.  
>Your topic;
>
>I am currently trying
>to evaluate the success of a peer education curriculum designed to motivate
>women to get breast and cervical screenings
>
>is one I am fairly familiar with, I did a series of presentations for our 
>project here in Missouri.  I believe Marsha Drew Hohn also did some amazing 
>work in Lowell, Mass in a family literacy program, on the same subject. She 
>published her work as a NIFL Fellowship Report, I think you can order it 
>from ed.gov/pubs to see what measures she used.
>
>The outcomes you want to consider are women's knowlege, attitudes, skills, 
>and behaviors associated with BCS.  Is there a correlation between knowing 
>how important it is to do screening and then actually do monthly BSE's and 
>get regular mams and paps?  That's the real connection you're trying to 
>document.
>
>I suggest you start by reading Marsha's outstanding report (it is online at 
>NIFL but it's a pretty clunky set of PDFs) and then giving her a call.
>
>I've also included some web sites to help you to consider different 
>measures and evaluation designs.
>
>
>
>   1. American Evaluation Association
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=1&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D57f5faff626e8334%26clickedItemRank%3D3%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.eval.org%252F%26invocationType%3D-%26fromPage%3DNSCPIndex2%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.eval.org%2F>
>
>      Devoted to the application and exploration of evaluation in all
>      its forms. ... Click here to go directly to the Evaluation 2004
>      website. ...
>      http://www.eval.org/
>   2. Evaluation Criteria from "The Good, The Bad & The Ugly: or, Why
>      ...
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=1&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D57f5faff626e8334%26clickedItemRank%3D6%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Flib.nmsu.edu%252Finstruction%252Fevalcrit.html%26invocationType%3D-%26fromPage%3DNSCPIndex2%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Flib.nmsu.edu%2Finstruction%2Fevalcrit.html>
>
>      A easy to use guide for web evaluation. Lists evaluation criteria
>      with links to actual pages that illustrate each point. ...
>      Evaluation Criteria. ...
>      http://lib.nmsu.edu/instruction/evalcrit.html
>   3. evalwebs
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=2&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D59bf6f74fc9838eb%26clickedItemRank%3D13%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fgsociology.icaap.org%252Fmethods%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fgsociology.icaap.org%2Fmethods%2F>
>
>      ... Resources for Methods in Evaluation and Social Research. This
>      page lists FREE resources for methods in evaluation and social
>      research. ...
>      http://gsociology.icaap.org/methods/
>   4. Resource Selection and Information Evaluation
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=3&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c5510%26clickedItemRank%3D23%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Falexia.lis.uiuc.edu%252F%257Ejanicke%252FEvaluate.html%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Falexia.lis.uiuc.edu%2F%7Ejanicke%2FEvaluate.html>
>
>      Resource Selection and Information Evaluation. ... Resource
>      selection and information evaluation involves answering three main
>      questions. ...
>      http://alexia.lis.uiuc.edu/~janicke/Evaluate.html
>   5. WWW Virtual Library: Evaluation
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=3&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c5510%26clickedItemRank%3D27%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.policy-evaluation.org%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.policy-evaluation.org%2F>
>
>      The World Wide Web Virtual Library: Evaluation. The Social
>      Policy-Evaluation area of the the World-Wide Web Virtual Library.
>      Links ...
>      http://www.policy-evaluation.org/
>   6. The Evaluation Center
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=3&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c5510%26clickedItemRank%3D28%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.wmich.edu%252Fevalctr%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.wmich.edu%2Fevalctr%2F>
>
>      The Evaluation Center: Provides information about Center projects,
>      publications, staff, history, and support services, including the
>      Directory of Evaluators ...
>      http://www.wmich.edu/evalctr/
>   7. Practical Assessment, Research and Evaluation
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=3&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c5510%26clickedItemRank%3D29%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fpareonline.net%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fpareonline.net%2F>
>
>      ... on-line journal provides education professionals access to
>      refereed articles that can have a positive impact on assessment,
>      research, evaluation, and teaching ...
>      http://pareonline.net/
>   8. Online Evaluation Resource Library
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=4&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D59bf6f74fc984211%26clickedItemRank%3D37%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Foerl.sri.com%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Foerl.sri.com%2F>
>
>      home, : Online Evaluation Resource Library. ... Welcome to OERL,
>      the Online Evaluation Resource Library. ... OERL has been serving
>      the evaluation community for 4 years. ...
>      http://oerl.sri.com/
>   9. Basic Guide to Program Evaluation
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=5&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D59bf6f74fc9849b7%26clickedItemRank%3D46%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.mapnp.org%252Flibrary%252Fevaluatn%252Ffnl_eval.htm%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.mapnp.org%2Flibrary%2Fevaluatn%2Ffnl_eval.htm>
>
>      Basic Guide to Program Evaluation Written by Carter McNamara, MBA,
>      PhD | Applies to nonprofits and for-profits unless noted
>      First-Timers | Library Catalog ...
>      http://www.mapnp.org/library/evaluatn/fnl_eval.htm
>  10. Rubrics
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=6&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c6acd%26clickedItemRank%3D52%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.ncsu.edu%252Fmidlink%252Fho.html%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.ncsu.edu%2Fmidlink%2Fho.html>
>
>      ... Rubrics and Evaluation Resources. ** NOTE: Download ... you.
>      The form also provides for self-evaluation, as well as
>      teacher-evaluation. You ...
>      http://www.ncsu.edu/midlink/ho.html
>  11. evaluation cookbook contents
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=7&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D59bf6f74fc98555e%26clickedItemRank%3D63%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.icbl.hw.ac.uk%252Fltdi%252Fcookbook%252Fcontents.html%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.icbl.hw.ac.uk%2Fltdi%2Fcookbook%2Fcontents.html>
>
>      A practical guide to evaluation methods for lecturers, for
>      browsing online. A publication from LTDI. to ... INITIATIVE,
>      Evaluation Cookbook. ...
>      http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html
>  12. MEASURE Evaluation - Home Page
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=7&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D59bf6f74fc98555e%26clickedItemRank%3D64%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.cpc.unc.edu%252Fmeasure%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.cpc.unc.edu%2Fmeasure%2F>
>
>      Monitoring and Evaluation to Assess and Use Results. ...
>      http://www.cpc.unc.edu/measure/
>  13. User-Friendly Handbook for Project Evaluation:
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=8&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D57f5faff626eb9b2%26clickedItemRank%3D79%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.ehr.nsf.gov%252Frec%252Fprograms%252Fevaluation%252Fhandbook%252F%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.ehr.nsf.gov%2Frec%2Fprograms%2Fevaluation%2Fhandbook%2F>
>
>      User-Friendly Handbook for Project Evaluation: ... Table of
>      Contents & Introduction to the User-Friendly Handbook for Project
>      Evaluation: ...
>      http://www.ehr.nsf.gov/rec/programs/evaluation/handbook/
>  14. The Evaluation Exchange - at the Harvard Family Research Project
>      ...
>      
><http://search.netscape.com/ns/boomframe.jsp?query=evaluation&page=10&offset=0&result_url=redir%3Fsrc%3Dwebsearch%26requestId%3D4f4e6e365c7f9d%26clickedItemRank%3D92%26userQuery%3Devaluation%26clickedItemURN%3Dhttp%253A%252F%252Fwww.gse.harvard.edu%252Fhfrp%252Feval.html%26invocationType%3Dnext%26fromPage%3DNSCPNextPrev%26amp%3BampTest%3D1&remove_url=http%3A%2F%2Fwww.gse.harvard.edu%2Fhfrp%2Feval.html>
>
>      Harvard Family Research Project's free periodical, The Evaluation
>      Exchange, provides a forum for knowledge-sharing among evaluators,
>      policymakers, and ...
>      http://www.gse.harvard.edu/hfrp/eval.html
>
>McREL and others have free publications (print) on evaluation - I have a 
>bunch of other resources that I'd be happy to share.
>
>Jeri Levesque, Ed.D.
>Associate Professor, Director, Webster Institute for Literacy
>Webster University
>St. Louis, MO
>
>
>North Central Regional Education Lab   Evaluation Reports     
>http://www.ncrel.org/re/mdade/
>
>
>Schwerdtfeger, Jane wrote:
>
>>Laura, your topic sounds really interesting.  It would be a great topic to
>>explore, and maybe we could get some evaluators or psychometricians who
>>focus on educational assessment to comment on the discussion too.
>>
>>Jane Schwerdtfeger
>>
>>
>>
>>
>

_________________________________________________________________
Watch LIVE baseball games on your computer with MLB.TV, included with MSN 
Premium! 
http://join.msn.com/?page=features/mlb&pgmarket=en-us/go/onm00200439ave/direct/01/
Next message: Jeri Levesque: "[NIFL-ASSESSMENT:489] RE: some definitions"
Previous message: Eileen Eckert: "[NIFL-ASSESSMENT:487] RE: assessing soft skills"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
This archive was generated by hypermail 2b30 : Thu Dec 23 2004 - 09:46:14 EST