Оглавление
Группа авторов. Collaborative Approaches to Evaluation
Collaborative Approaches to Evaluation
Contents
Volume Editors’ Introduction
References
Preface
Reference
Acknowledgments
Editorial Board Members
About the Editor
Part A Introduction
1 Situating Evidence-Based Principles to Guide Practice in Collaborative Approaches to Evaluation (CAE)
What are Collaborative Approaches to Evaluation? Background
Collaborative Approaches to Evaluation: What’s in a Name?
When Do We Use CAE?
When It’s About More Than Impact
When It’s Developmental
When Transformation Is Intentional
Why CAE? The Three P’s of CAE Justification
Ethical Considerations
What Does CAE Look Like in Practice?
Why Do We Need Principles to Guide Practice? Why and How Are Principles Valuable?
Warrants for CAE Principles
Evidence-based Principles to Guide CAE Practice. Systematic Approach
Description of the CAE Principles
Envisioned Uses and Applications of CAE Principles
Prospective Planning, Framing, and Doing
Retrospective Analysis and Critique
Designing and Delivering Education and Training
Reviewing and Developing Evaluation Policy
Translating and Applying in Cross-cultural Contexts
Conceptually Framing Research on Evaluation
The Global Test Drive of the CAE Principles. Rationale
Promotion and Launch
Call for Field Studies
Review Process
Questions for Reflection
References
Rationale
Review and Publication Process
Content Focus
Proposal format and evaluation
More Information
Descriptions of Images and Figures
Part B Field Studies
Introduction
The Classroom Context
Methods
The Study
The Analysis
The Class Discussion: A Reflection
Dialogue, Reflection, and Learning
Diversity and Enhanced Learning
Theoretical Tensions and Contextual Adaptability
Summary
Further Reflections and Concluding Thoughts
Questions for Reflection
References
2 Participatory Evaluation of Cancer Prevention and Care Services A Case Study From Valle de la Estrella, Costa Rica
Introduction
Method
Data Collection
The Simulation Game
Interviews
Data Analysis
Findings
Clarifying Motivation for Collaboration
Fostering Meaningful Relationships
Developing a Shared Understanding of the Evaluated Program
Promoting an Appropriate Participatory Process
Monitoring and Reacting to the Availability of Resources
Promoting Evaluative Thinking
Follow Through to Realize Use
Discussion
Questions for Reflection
References
Descriptions of Images and Figures
3 Promoting Learning Through a Collaborative Approach to Evaluation A Retrospective Examination of the Process and Principles
Introduction
Background
Research Method
Participants
Data Collection
Analysis
Findings and Discussion
Focusing Purposes and Priorities
Communicating Clearly
Developing Interpersonal Relationships
Learning Through Engagement and Involvement
Paying Attention to Timing and Momentum
Conclusions and Future Considerations
Questions for Reflection
References
4 The Saafa Program for Excellence in the Sciences An Application of the Principles to Guide Collaborative Approaches to Evaluation
Introduction
Context of the Field Study
The Israeli Education System
The Bedouin Community of the Negev
The Saafa Program for Excellence in the Sciences
Step One: The Evaluation. The Evaluation Team
Methodology
Approach—CAE
Evaluation Findings
Step Two: A Post Facto Review of the CAE Principles in Practice. The Analysis
The Fit of the CAE Principles
Clarify Motivation for Collaboration
Foster Meaningful Relationships
Develop a Shared Understanding of the Program
Promote Appropriate Participatory Processes
Monitor and Respond to Resource Availability
Monitor Evaluation Progress and Quality
Promote Evaluative Thinking
Follow Through to Realize Use
Insights from the Field Study of the CAE Principles
Conclusion
Questions for Reflection
References
Descriptions of Images and Figures
5 Toward a Better Understanding of Evaluation Use and Collaborative Approaches A Case Study of a School Improvement Program Evaluation
Introduction
Evaluator’s Positionality and Case Study Context
Program Evaluation, Results, and Use
CAE Case Study Methods
CAE Case Study: Deductive Findings
Clarify Motivation for Collaboration
Foster Meaningful Relationships
Develop a Shared Understanding of the Program
Promote Appropriate Participatory Practices
Monitor and Respond to Resource Availability
Monitor Evaluation Progress and Quality
Promote Evaluative Thinking
Follow Through to Realize Use
CAE Case Study: Inductive Findings
Organizational Readiness in Combination With Evaluator Ability to Promote Evaluative Inquiry and Collaboration
High Quality Evaluation Planning and Process With an Emphasis on the Timeliness of Findings and Recommendations
Long-Term Commitment to the Evaluation to Support Continuous Improvement
Conclusions and Implications
Questions for Reflection
References
6 Roles and Functions of the Community Manager Within the Framework of Collaborative Approaches to Evaluation (CAE) Case Analysis of the Galibar Community Development Plan (Spain)
Introduction
Theoretical Framework
Case Study Presentation. Context
Method
Results
Self-Perception Regarding the Professional Role of Community Manager
Others’ Perceptions of the Professional Role of the Galibar Community Manager
Phase 1: Negotiating the Terms of the PE
Phase 2: Supporting the Evaluators’ Acceptance in the Community
Phase 3: Initial Dissemination of the PE Process in the Community
Phase 4: Implementing and Monitoring the PE Process
Phase 5: Wide Dissemination of PE within the Community
Analysis of Results in Relation to CAE Principles
Conclusions
Questions for Reflection
References
Descriptions of Images and Figures
7 Building Capacity in Program Practitioner Realist Evaluation Through Application of CAE Principles
Introduction
Context
Development of the Integrated Instructional Framework
Why Realist Evaluation?
Building the Integrated Instructional Framework
Developing Program Theory
Developing Realist Evaluation Questions
Agreeing Appropriate Methods to Answer Questions
Analyzing Data and Findings to Enhance Use
Communicating Evaluation Findings
Evaluating the Integrated Instructional Framework. Methodology
Findings
Group 1 Narrative: New and Emerging Evaluators (Six Participants)
Group 2 Narrative: Polished Problem Solvers (Four Participants)
Group 3 Narrative: Passive Passengers (Three Practitioners)
Group 4 Narrative: Proficient Yet Skeptical Evaluators (Two Practitioners, Each in the Same Project)
Discussion and Conclusions. Summary of Findings
To What Extent Do CAE Principles Leverage Capacity?
Limitations
Implications for CAE and Ongoing Use of IIF for Evaluation Capacity Building in SfD
Questions for Reflection
References
Descriptions of Images and Figures
81 Comparing the Validity of Two Sets of Evaluation Principles Adding Value to Both
Introduction: Purpose and Contribution
Methodology
Background of the CAE and DECI Initiatives. CAE Principles
Why the CAE Principles?
DECI Principles
Comparative Analysis of CAE and DECI-hybrid Principles
Clarify Motivation for Collaboration
Foster Meaningful Relationships
Develop Shared Understanding of Program
Promote Appropriate Participatory Processes
Monitor and Respond to Resource Availability
Monitor Evaluation Progress and Quality
Promote Evaluative Thinking
Follow Through to Realize Use
Discussion
Conclusions
What the DECI-Hybrid Approach Gains from CAE
What CAE Gains From the DECI-Hybrid Approach
Questions for Reflection
References
Descriptions of Images and Figures
9 The View From the Classroom A Reflection on the Use of the CAE Principles in a Pedagogical Setting
Part C Integration
10 CAE Principles What Have We Learned?
Introduction
Applications of CAE Principles
Observed Applications
Retrospective Field Studies
Research on Evaluation
Pedagogical Applications
Convergent Validation
Missing Applications
Cautionary Note
Contributions to the CAE Knowledge Base
Relationship-Building and Use
Methodological Considerations
Pedagogical Benefits
CAE Principle-specific Findings and Implications
Validity Matters
In-Context Uses
Evaluator Benefits
Pedagogical Benefits
Cross Validation
Issues for Consideration
Specifications for Concrete Action
Principle-Specific Issues
Missing or Implicit Principles
Concluding Thoughts
References
Index
