October 16, 2023

Thomaz Chianca, Ph.D.

Managing Partner

COMEA Relevant Evaluations

Jane Davidson, Ph.D.

Founder, Real Evaluation

Drs. Chianca and Davidson visited The Evaluation Center to discuss their work with Save the Children International and the Laudes Foundation. They provided an in-depth view of a retrospective impact evaluation they did in Ethiopia for Save the Children that ended up as the main case study they developed for an e-course on impact evaluation they recently launched.

March 13, 2024

Felicia R. Bohanon, Ed.D.

Executive Director, Office of Precollegiate Programs

Northern Illinois University

Dr. Bonahan’s visit included in-person meetings with Evaluation Center and Evaluation Lab staff, doctoral students, and Michigan Association for Evaluation board members. She also gave a presentation for our Evaluation Cafe series titled “The Synergy of Evaluation and Story.” Her time at WMU continued the twelve-year tradition of official visits by American Evaluation Association presidents.

Evaluation Café features discussions and presentations about evaluation over the lunch hour. Café presenters introduce new ideas, solicit feedback on real-world evaluation issues, and share recent evaluation work. This longstanding speaker series is offered both in-person and virtually, with the new hybrid format leading to increased participation.

In 2023-24, The Evaluation Center hosted 12 presentations featuring 16 speakers on diverse topics. 

EvaluATE hosts a series of webchats, which are facilitated conversationsto support peer-to-peer learning about evaluation. EvaluATE is the evaluation hub for the National Science Foundation’s Advanced Technological Education program.

In 2023-24, EvaluATE hosted 12 webchats on the following topics:

• Collecting and Reporting Demographic Data.
• Post-Evaluation Action Planning.
• Asset-focused Evaluation Reporting.
• Managing Evaluation Projects.
• Qualitative Evaluation.
• Preparing for the 2024 ATE Survey.
• Preparing for the 2024 ATE Survey.
• Reflecting on 2023.
• Lessons from ATE evaluators.
• Creating evaluation summaries.
• Publishing your evaluation findings & IRB woes.
• Finding & hiring an evaluator.
• The role of AI in evaluation.

Evaluation Center staff regularly present at national and regional conferences. In 2023-24, our staff gave 12 presentations at five conferences.

Becho, L. W., Lopez, M. (2023, July). Crafting clear and concise logic models for successful ATE proposals and evaluations. Presentation at the High Impact Technology Exchange Conference, Atlanta, GA.

Becho, L. W., Leung, K., & Lewis, J. (2023, October). Developing and assessing success metrics for work-based learning. Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Becho, L. W., & Sturgis, E. (2023, October). Celebrating ATE’s evolution through findings from the ATE Survey. Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Becho, L. W., Owens, K., & Silvers, P. (2023, October). What PIs need to know about preparing NSF annual reports – Now! Presentation at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Becho, L.W., & Dean, K. (2023, October). Words create worlds: Using appreciative inquiry and the power of stories for strategic thinking. Presentation at the American Evaluation Association Conference, Indianapolis, IN.

Becho, L.W. Stories from an evaluator. Invited presentation at the Tennessee Tech University annual symposium for Program Planning and Evaluation, Virtual, April 2024.

Echols-Miller, E., Osbourne, J., Watts, B., & Wingate, L. (Oct. 13, 2023). Fulfilling the multi-faceted commitments of university-based evaluation centers. Presentation at the American Evaluation Association annual conference.

Marshall, V., Slowinski, M. (2023, July). Workplace-based learning in ATE. Poster at the High Impact Technology Exchange Conference, Atlanta, GA. 

Marshall, V. (2023, July). From evaluation to action: Using evaluation findings to improve your project. Presentation at the High Impact Technology Exchange Conference, Atlanta, GA. 

Marshall, V. (2023, October). Values and valuing in evaluation: A mixed method study. Poster at the American Evaluation Association Conference.

Marshall, V., McKeown, G. (2023, October). Facilitators to evaluation in ATE. Breakfast roundtable at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Robertson, K. N., & Wingate, L. A. (2024, April). Valeo: Practical evaluation training powered by Western Michigan University. Western Michigan Evaluators Network. [virtual] 

Evaluation Center staff members published 18 blogs in 2023-24.

Becho, L. W., & Harnar, M. (2023, November). Supporting open-access evaluation scholarship through JMDE. AEA365 blog. 

Hooker, S. (2023, November). Evaluation Café: Four decades of learning and growth. AEA365 blog. 

Hooker, S. (2024, January). Celebrating excellence: Insights from the 2023 Outstanding ATE Evaluation Awards nominations. EvaluATE blog.

Hooker, S. (2023, July). Reflecting on the 2023 ATE Evaluation Summit: Advancing evaluation practices in the ATE program. EvaluATE blog.

Marshall, V. (2024, May). Practicing what you preach: How do you talk about values? AEA365 blog.

Marshall, V., & Becho, L. W. (2024, March). Lessons learned from facilitating a virtual event. EvaluATE blog. Western Michigan University.

Marshall, V. (2024, June). Working with an evaluator: What to know. EvaluATE blog. 

Robertson, K. & Wingate, L. A. (2023, December 1). Developing evaluation elearning: Our journey and lessons learned. AEA365 blog. 

Robertson, K. & Wingate, L.A. (2024, April). Valeo: Practical self-paced online evaluation courses. EvaluATE blog. 

Robertson, K. & Wingate, L. (2023, August). Communicating a compelling evaluation plan in your ATE proposal: Using your evaluation results. EvaluATE blog. 

Robertson, K. & Wingate, L. (2023, July). Communicating a compelling evaluation plan in your ATE proposal: Reporting. EvaluATE blog. 

Robertson, K. & Wingate, L. (2023, July). Communicating a compelling evaluation plan in your ATE proposal: Data analysis and interpretation. EvaluATE blog. 

Robertson, K. & Wingate, L. (2023, July). Communicating a compelling evaluation plan in your ATE proposal: Data collection plan. EvaluATE blog. 

Robertson, K. & Wingate, L. (2023, July). Communicating a compelling evaluation plan in your ATE proposal: Evaluation focus. EvaluATE blog. 

Watts, B. (2023, November). Scholarship can support evaluation success. AEA365 blog.

Wingate, L. A. (2023, November 28). In defense of checklists: More than checking a box. AEA365 blog.

Wingate, L. A. (2023, November 26). Celebrating The Evaluation Center’s 50 years at Western Michigan University. AEA365 blog.

Youker, B. (2023, December). Managing student-evaluator anxiety and interpersonal communication. AEA365 blog.

The Evaluation Center is home to the Journal of MultiDisciplinary Evaluation. Center staff regularly publish articles on evaluation theory, practice, and methods. In 2023-24, we published nine articles in as many journals.  

Lee-Easton, M., Magura, S., & Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P, Lorenz-Lemberg B, Levitas, M, Achtyes, E. D. (2024). Polysubstance use patterns among individuals applying for opioid-use disorder treatment in the U.S. Journal of Substance Use, 1–8. https://doi.org/10.1080/14659891.2024.2372093.

Lee-Easton, M. J., & Magura, S. (2023). Discrepancies in ratings of behavioral healthcare interventions among evidence-based program resources websites. Inquiry: A Journal of Medical Care Organization, Provision and Financing, 60, 469580231186836. https://doi.org/10.1177/00469580231186836

Lee-Easton, M. J., Magura, S., & Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P, Lorenz-Lemberg B, Levitas, M, Achtyes, E. (2024). Direct-to-definitive urine and oral fluid test results for unscreened and rarely screened drugs in individuals applying for methadone treatment in 7 U.S. states. Journal of Psychoactive Drugs, 1–12. https://doi.org/10.1080/02791072.2024.2314220.

Magura, S., Lee-Easton, M. J., & Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P, Lorenz-Lemberg, B, Levitas, M, Achtyes, E. D. (2024). Prevalence and drug use correlates of inadvertent fentanyl exposure among individuals misusing drugs in seven U.S. states. Journal of Addictive Diseases, 1–9. https://doi.org/10.1080/10550887.2023.2293643.

Magura, S., Lee-Easton, M. J., & Abu-Obaid, R., Reed, P., Allgaier, B., Fish, E., Maletta A.L., Amaratunga P, Lorenz-Lemberg B, Levitas, M Achtyes, E. D. (2023). Comparing presumptive with direct-to-definitive drug testing in oral fluid vs. urine for a U.S. national sample of individuals misusing drugs. Drug and Alcohol Dependence, 250, https://doi.org/10.1016/j.drugalcdep.2023.110894.

Magura, S., Lee, M.J., Abu-Obaid, R.N., Landsverk, J., DeCamp, W. Rolls-Reutz, J. … Perkins, D.F. (2023). The influence of evidence-based program registry websites for dissemination of evidence-based interventions in behavioral healthcare. Evaluation and Program Planning, 97(102214).

Montrosse-Moorhead, B., Schröter, D., & Becho, L. W. (2024). The garden of evaluation approaches. American Journal of Evaluation, 42(2), 166-185. https://doi.org/10.1177/10982140231216667

Youker, B. W., & Ballard, A. (2024). Goal-free evaluation: An orientation for foundations’ evaluations – Updated 2024. The Foundation Review, 16(1). (Original work published 2014.) https://doi.org/10.9707/1944-5660.1697

Youker, B. W. (2024). Scriven's goal-free evaluation. Journal of Multidisciplinary Evaluation, 20 (47). https://doi.org/10.56645/jmde.v20i47.1005

EvaluATE hosts open-access webinars to support evaluators and project staff with practical tools and insights. Each session is recorded and made available to the evaluation community, ensuring continued access to critical learning materials at any time.

In 2023-24, Evaluate held five webinars:

Becho, L.W., & Hooker, S., (2024, June). Evaluation essentials for non-evaluators: Understanding the basics and benefits of evaluation.

Becho, L.W., & Hooker, S., (2024, March). Strategies and insights into evaluation plans for NSF ATE proposals (Mentor Connect).

Becho, L.W., & Hooker, S., (2024, February). Evaluation essentials for non-evaluators: Understanding the basics and benefits of evaluation (Mentor Connect).

Becho, L.W., & Vanegas, G., (2024, February). Transforming STEM education: Unleashing qualitative insights for inclusive learning environments.

EvaluATE hosts workshops at various conferences to promote sound evaluation practice. In 2023-24, EvaluATE presented four workshops at three conferences:

Becho, L. W., Lopez, M. (2023, October). Interpreting Evaluation Data – Unlocking Insights for Project Improvement. Preconference workshop at the Advanced Technological Education Principal Investigators Conference, Washington, DC.

Becho, L. W., Brobst, J., Brown, E., Gruber, J., Heath, B., LoRe, S., & Tewalt, T. ATE Evaluators: Connect, Share, Learn. Special Interest Group (SIG) at the High Impact Technology Exchange Conference, Atlanta, GA, July 2023. 

Lopez, M., & Wingate, L. A. (2024, April). A grants professional’s guide to getting the most out of your evaluation. Workshop at the Florida Council for Resource Development conference, Miami, FL.

Lopez, M., & Wingate, L. A. (2024, April). Strategies and insights for evaluation planning for federal grant proposals. Workshop at the Florida Council for Resource Development conference, Miami, FL.