Using logic model and visualization to conduct portfolio evaluation

被引:3
作者
Wu, Huang [1 ]
Shen, Jianping [1 ]
Jones, Jeffrey [2 ]
Gao, Xingyuan [3 ]
Zheng, Yunzheng [1 ]
Krenn, Huilan Y. [4 ]
机构
[1] Western Michigan Univ, Dept Educ Leadership Res & Technol, Kalamazoo, MI 49008 USA
[2] Western Michigan Univ, Dept Teaching Learning & Educ Studies, Kalamazoo, MI 49008 USA
[3] East China Normal Univ, Inst Schooling Reform & Dev, Dept Educ, Shanghai, Peoples R China
[4] WK Kellogg Fdn, Battle Creek, MI USA
关键词
Logic model; Portfolio evaluation; Data visualization; Program evaluation and planning; PROGRAM; TOOL;
D O I
10.1016/j.evalprogplan.2019.02.011
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
Portfolio evaluation is the evaluation of multiple projects with a common purpose. While logic models have been used in many ways to support evaluation, and data visualization has been used widely to present and communicate evaluation findings, adopting logic models for portfolio evaluation and using data visualization to share findings simultaneously is surprisingly limited in the literature. With the data from a sample portfolio of 209 projects which aims to improve the system of early care and education (ECE), this study illustrated how to use logic model and data visualization techniques to conduct a portfolio evaluation by answering two evaluation questions: "To what extent are the elements of a logic model (strategies, sub-strategies, activities, outcomes, and impacts) reflected in the sample portfolio?" and "Which dominant paths through the logic model were illuminated by the data visualization technique?" For the first question, the visualization technique illuminated several dominant strategies, sub-strategies, activities, and outcomes. For the second question, our visualization techniques made it convenient to identify critical paths through the logic model. Implications for both program evaluation and program planning were discussed.
引用
收藏
页码:69 / 75
页数:7
相关论文
共 50 条
[41]   Effectiveness of a Supporting System for Research Planning Using Logic Model and Balanced Scorecard [J].
Takuma, Hironori ;
Sakurai, Makoto ;
Kameyama, Hideo .
KAGAKU KOGAKU RONBUNSHU, 2013, 39 (03) :256-264
[42]   Logic model of the Franche-Comte Regional Health Project: advantages and limitations for the evaluation process [J].
Michaud, Claude ;
Sannino, Nadine ;
Duboudin, Cedric ;
Baudier, Francois ;
Guillin, Caroline ;
Billondeau, Christine ;
Mansion, Sylvie .
SANTE PUBLIQUE, 2014, 26 (04) :469-474
[43]   Development of a Logic Model to Guide Implementation and Evaluation of a Mobile Integrated Health Transitional Care Program [J].
Seidl, Kristin L. ;
Gingold, Daniel B. ;
Stryckman, Benoit ;
Landi, Colleen ;
Sokan, Olufunke ;
Fletcher, Mark ;
Marcozzi, David .
POPULATION HEALTH MANAGEMENT, 2021, 24 (02) :275-281
[44]   A logic model for pharmaceutical care [J].
Molto-Puigmarti, Carolina ;
Vonk, Robert ;
van Ommeren, Gerlise ;
Hegger, Ingrid .
JOURNAL OF HEALTH SERVICES RESEARCH & POLICY, 2018, 23 (03) :148-157
[45]   Articulating a Role for Program Evaluation in Responsible Conduct of Research Programs [J].
Olson, Lynne E. .
ACCOUNTABILITY IN RESEARCH-POLICIES AND QUALITY ASSURANCE, 2014, 21 (01) :26-33
[46]   The Functional Model of Using Visualization and Digitalization for Media Literacy Development in Media Education Process [J].
Makarova, Elena A. ;
Makarova, Elena L. .
MEDIA EDUCATION-MEDIAOBRAZOVANIE, 2019, (04) :547-556
[47]   Bridging the research-practice gap in disaster relief: using the IFRC Code of Conduct to develop an aid model [J].
Coles, John B. ;
Zhang, Jing ;
Zhuang, Jun .
ANNALS OF OPERATIONS RESEARCH, 2022, 312 (02) :1337-1357
[48]   Evaluating the Potential Business Benefits of Ecodesign Implementation: A Logic Model Approach [J].
Rodrigues, Vinicius P. ;
Pigosso, Daniela C. A. ;
Andersen, Jakob W. ;
McAloone, Tim C. .
SUSTAINABILITY, 2018, 10 (06)
[49]   Devil is in the details: Using logic models to investigate program process [J].
Peyton, David J. ;
Scicchitano, Michael .
EVALUATION AND PROGRAM PLANNING, 2017, 65 :156-162
[50]   Visualization of trends using RadViz [J].
Novakova, Lenka ;
Stepankova, Olga .
JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2011, 37 (03) :355-369