Mixed Methods in Evaluation: History and Progress

Introduction

• Mixed Methods: Combines quantitative and qualitative approaches to enhance accuracy and reliability.
• Triangulation: Use of multiple methods to increase measurement accuracy and conclusion certainty.

Key Topics in the Chapter

• Methodological choices scholarship.
• Definitions of mixed methods in evaluation.
• Mixed Method design in evaluation.
• Increased interest and demand for mixed methods evaluations.
• Overview of mixed methods frameworks and assumptions.
• Criteria for judging mixed methods studies quality.

History of Evaluation and Mixed Methods

• Evaluation practice dates back to determining safety of foods.
• U.S. professional evaluation roots trace to 1800s with program inspections.
• Formal evaluation profession recognized in 1960s with Great Society initiatives.
• Mixed methods traced back to 1800s; formally recognized in late 1980s/1990s.

Scope of the Book

• Focus on mixed methods designs and implications for data collection.
• Applicability of mixed methods for various evaluands.

Differentiating Mixed Methods Research and Evaluation

• Mixed methods include both qualitative and quantitative strategies.
• Evaluations focus on decision-making about evaluand value.
• Mixed methods evaluation includes both data collection and analysis techniques.

Increased Interest and Demand for Mixed Methods Evaluations

• Professional Developments: Growth in books, journals, and organizations focused on mixed methods.
• Complexity in Evaluation Contexts: Suitable for complex problems requiring diverse approaches.

Complexity Theory and Mixed Methods

• Importance in addressing complex issues like climate change and social inequities.
• Mixed methods provide language for discussing methodology and addressing diverse needs.

Philosophical Frameworks for Mixed Methods Evaluation

• Positivism/Postpositivism: Based on empirical data and reality measurement.
• Constructivism: Emphasizes socially constructed realities.
• Pragmatism: Focuses on practical solutions and use of both approaches contextually.
• Transformative Paradigm: Addresses social justice and human rights.
• Dialectical Pluralism: Uses multiple paradigms for comprehensive understanding.

Mixed Methods Designs

• Concurrent Design: Simultaneous data collection.
• Sequential Design: Staged data collection (e.g., qualitative followed by quantitative).
• Embedded Design: Dominance of one method with the integration of another.

Criteria for Judging Quality in Mixed Methods

• Explicit design usage.
• Combination of quantitative and qualitative data.
• Integration points for stronger study results.
• Literature context and philosophical alignment.

Conclusion

• Mixed methods evaluations address a range of contexts and evaluation types.
• Future exploration of gender analysis, Indigenous frameworks, and other innovative designs.