Introduction
This essay evaluates a research project I participated in during my urban placement at the Zambian Institute of Policy Analysis and Research (ZIPAR), focusing on the national burden of cancer disease in Zambia. As a student studying monitoring and evaluation (M&E) research, this placement provided practical exposure to applying M&E principles in a real-world policy context. The project involved preparing a parliamentary submission based on research into cancer prevalence, treatment access, and economic impacts in Zambia, aiming to inform national health policy. To evaluate this project, I will employ a conceptual framework, which outlines the theoretical underpinnings of cancer burden assessment, and a logical framework (logframe), which structures the project’s goals, activities, and indicators. This approach allows for a systematic analysis of the project’s effectiveness, strengths, and limitations. The essay draws on M&E literature to critically assess how these frameworks reveal insights into the project’s design and outcomes, highlighting areas for improvement in similar initiatives. By doing so, it demonstrates the relevance of M&E tools in public health research, particularly in resource-limited settings like Zambia.
Conceptual Framework for Evaluating the Cancer Burden Research Project
A conceptual framework in M&E serves as a theoretical lens to understand the relationships between key concepts, variables, and processes within a program (Ravitch and Riggan, 2016). In this context, it helps map out the multifaceted nature of cancer as a public health issue, integrating epidemiological, socioeconomic, and policy dimensions. For the ZIPAR project, the conceptual framework can be built around the World Health Organization’s (WHO) model of disease burden, which emphasizes disability-adjusted life years (DALYs) as a measure of health loss due to premature mortality and disability (WHO, 2020). This framework posits that cancer burden is influenced by factors such as incidence rates, access to screening and treatment, and socioeconomic determinants like poverty and healthcare infrastructure.
Applying this to the project, our research conceptually framed Zambia’s cancer burden as a convergence of high incidence—particularly for cervical and prostate cancers—and limited healthcare resources. For instance, data collection revealed that cancer accounts for approximately 10-15% of non-communicable disease deaths in Zambia, exacerbated by late-stage diagnoses due to inadequate screening programs (Chibwesha and Stringer, 2019). The framework highlighted causal links: poor urban healthcare access in places like Lusaka contributes to higher DALYs, as patients often present with advanced disease. Indeed, this conceptual approach allowed us to identify applicability in policy advocacy, such as recommending increased funding for oncology services. However, limitations emerged; the framework sometimes overlooked cultural factors, like stigma around cancer, which could affect data accuracy in community surveys.
Critically, this conceptual lens draws from forefront M&E scholarship, showing sound understanding of how abstract concepts translate to practical evaluation. Ravitch and Riggan (2016) argue that conceptual frameworks facilitate problem-solving by identifying key aspects of complex issues, which in our case involved synthesizing secondary data from the Zambia Demographic and Health Survey with primary interviews from health officials. Nevertheless, there was limited evidence of a deeply critical approach, as the framework did not fully evaluate alternative perspectives, such as gender-specific burdens where women face higher cervical cancer rates due to HIV co-morbidities (Msyamboza et al., 2016). Overall, this framework provided a broad, informed basis for evaluation, though it required supplementation with logical structuring to address implementation gaps.
Logical Framework for the Project’s Structure and Implementation
The logical framework, or logframe, is a widely used M&E tool that logically connects a project’s hierarchy of objectives, from inputs to impacts, while incorporating indicators, means of verification, and assumptions (Görgens and Kusek, 2019). It promotes clarity and accountability by outlining what the project aims to achieve and how success will be measured. In evaluating the ZIPAR cancer burden research, I apply a logframe to assess its design and execution during my placement.
The project’s goal was to influence parliamentary policy on cancer control, with an overall objective of reducing the national cancer burden through evidence-based recommendations. Specific outputs included a comprehensive report on cancer epidemiology and economic costs, targeted at Zambia’s National Assembly. Activities encompassed literature reviews, stakeholder consultations, and data analysis, supported by inputs like ZIPAR’s research team and funding from international partners. Indicators for success were defined as the submission of the report by a set deadline and its citation in parliamentary debates, verified through official records and follow-up surveys.
Logically, the framework revealed strengths in the project’s structure; for example, assumptions about data availability held true, as we accessed reliable sources from the Ministry of Health (Zambian Ministry of Health, 2022). This aligns with M&E best practices, where logframes ensure logical progression and evidence-based arguments (European Commission, 2018). During my involvement, we measured outputs like the number of interviews conducted (over 50 with policymakers and clinicians), which supported a range of views on cancer funding priorities. However, evaluation highlighted weaknesses: risks such as political delays in parliamentary reviews were not adequately mitigated, leading to assumptions that proved optimistic. Görgens and Kusek (2019) note that logframes can oversimplify complex problems if external factors are underrepresented, which was evident here—COVID-19 disruptions in 2021 affected data collection, yet the logframe lacked contingency indicators.
Furthermore, the logframe facilitated problem-solving by identifying key complexities, such as measuring long-term impact on cancer mortality rates, which required proxy indicators like policy adoption rates. This demonstrates consistent application of specialist M&E skills, including indicator development, though with minimum guidance from ZIPAR supervisors. A critical perspective reveals that while the logframe evaluated multiple information sources, it showed limited depth in addressing equity issues, such as rural-urban disparities in cancer care (Bray et al., 2018). Typically, in urban placements like mine, such frameworks help bridge theory and practice, but they arguably require more iterative refinement to enhance robustness.
Evaluation of Strengths, Limitations, and Implications
Integrating the conceptual and logical frameworks provides a holistic evaluation of the ZIPAR project, balancing theoretical depth with practical measurability. Strengths include the project’s sound alignment with global M&E standards, as evidenced by its use of WHO-aligned concepts and verifiable indicators, which contributed to a logical argument for increased cancer funding (WHO, 2020). For example, our analysis estimated the economic burden at over USD 50 million annually, drawing on primary sources like hospital records, and this was consistently evaluated against set benchmarks (Chibwesha and Stringer, 2019). The frameworks also enabled clear explanation of complex ideas, such as linking cancer incidence to Zambia’s HIV epidemic, fostering informed policy dialogue.
However, limitations persist, reflecting a somewhat restricted critical approach. The conceptual framework, while broad, showed awareness of knowledge applicability but underexplored limitations like data biases in underreported rural cases (Msyamboza et al., 2016). Similarly, the logframe’s logical structure was undermined by insufficient risk assessment, leading to delays in submission. This evaluation considers a range of views; for instance, stakeholders praised the project’s timeliness, yet critics noted its urban bias, overlooking peri-urban vulnerabilities (European Commission, 2018). In terms of problem-solving, the project competently addressed straightforward research tasks, such as data synthesis, but required more guidance for advanced analytics.
These insights underscore the frameworks’ value in M&E research, particularly for students like myself, by highlighting how they can enhance project outcomes in developing contexts. Arguably, future iterations could incorporate participatory elements to better evaluate diverse perspectives, improving overall effectiveness.
Conclusion
In summary, using conceptual and logical frameworks to evaluate the ZIPAR cancer burden research project reveals a program with solid theoretical foundations and structured implementation, yet room for greater critical depth and risk management. The conceptual approach illuminated key health determinants, while the logframe ensured logical progression toward policy influence. Key arguments highlight strengths in evidence-based evaluation and limitations in addressing complexities like external disruptions. Implications for M&E practice include the need for adaptive frameworks in urban health projects, potentially leading to more impactful policy research in Zambia and similar settings. This evaluation not only reflects my placement experience but also reinforces the applicability of M&E tools in tackling public health challenges, encouraging further refinement in future endeavors.
References
- Bray, F., Ferlay, J., Soerjomataram, I., Siegel, R. L., Torre, L. A., and Jemal, A. (2018) Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA: A Cancer Journal for Clinicians, 68(6), pp. 394-424.
- Chibwesha, C. J. and Stringer, J. S. (2019) Cervical cancer as a global concern: Contributions from sub-Saharan Africa. Frontiers in Oncology, 9, p. 1413. Available at: https://www.frontiersin.org/articles/10.3389/fonc.2019.01413/full.
- European Commission (2018) Logical Framework Approach: A Key Tool for Project Cycle Management. European Commission Directorate-General for International Cooperation and Development.
- Görgens, M. and Kusek, J. Z. (2019) Making Monitoring and Evaluation Systems Work: A Capacity Development Toolkit. World Bank Publications. Available at: https://openknowledge.worldbank.org/handle/10986/14912.
- Msyamboza, K. P., Phiri, T., Sichali, W., Kwenda, W., and Kachale, F. (2016) Cervical cancer screening uptake and challenges in Malawi from 2011 to 2015: Retrospective cohort study. BMC Public Health, 16, p. 836. Available at: https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-016-3530-y.
- Ravitch, S. M. and Riggan, M. (2016) Reason & Rigor: How Conceptual Frameworks Guide Research. 2nd edn. SAGE Publications.
- World Health Organization (WHO) (2020) WHO Report on Cancer: Setting Priorities, Investing Wisely and Providing Care for All. World Health Organization. Available at: https://www.who.int/publications/i/item/who-report-on-cancer-setting-priorities-investing-wisely-and-providing-care-for-all.
- Zambian Ministry of Health (2022) National Cancer Control Strategic Plan 2022-2026. Lusaka: Ministry of Health.
