When the means modify the ends. (E)Valuating and transforming the purpose of a nonprofit organization through impact assessment.
Keywords:valuation, impact assessment, Economies of Worth, nonprofit organization.
In a context marked by a trend towards marketization and a rise in performance measures, nonprofit organizations (NPOs) suffer pressures to show that their activities have visible impacts. Based on the French pragmatist sociology’s Economies of Worth framework, we explore how NPOs may come to change what they value and what is their fundamental purpose. More specifically, we delve into the process of valuation triggered by the intervention of consultants to help a NPO develop an impact evaluation tool aimed at legitimizing its actions. Our findings show how this process led to a complete redefinition of the NPO’s “theory of change”, ultimately distantiating the NPO from its initial, explicit purposes.
Alberio, Marco and Tremblay, Diane-Gabrielle (2014). De la vision à l'action: la performance dans les entreprises d' insertion du Québec. ANSERJ, 5(4), 21-40
Annisette, Marcia, Vesty, Gillain and Amslem, Thierry (2017). Accounting Values, Controversies, and Compromises in Tests of Worth. In Cloutier, Charlotte,
Gond, Jean-Pascal and Leca, Bernard (Eds.), Justification, Evaluation and Critique in the Study of Organizations: Contributions from French Pragmatist Sociology (pp. 209-239), Bingley, UK: Emerald Publishing Limited.
Arvidson, Malin (2009). Impact and evaluation in the UK third sector: Reviewing literature and exploring ideas. Third Sector Research Centre, Working Paper 27.
Arvidson, Malin, and Lyon, Fergus (2014). Social Impact Measurement and Non-profit Organisations: Compliance, Resistance, and Promotion. Voluntas, 25(4), 869-886.
Bertilsson, Jon, and Rennstam, Jens (2018). The destructive side of branding: A heuristic model for analyzing the value of branding practice. Organization, 25(2), 260-281.
Boltanski, Luc, and Thévenot, Laurent (2006). On Justification: Economies of Worth. Princeton University Press. Originally published  De la justification. Les économies de grandeur. Paris: Éditions Gallimard.
Carman, Joanne G. (2010). The Accountability Movement. What’s Wrong With This Theory of Change? Voluntas, 39(2), 256-274.
Chenhall, Robert H., Hall, Matthew and Smith, David (2013). Performance measurement, modes of evaluation and the development of compromising accounts. Accounting, Organizations and Society, 38(4), 268-287.
Chiapello, Eve. (2015). Financialisation of Valuation. Human Studies, 38, 13-35.
Chiapello, Eve, and Gilbert, Patrick (2013). Sociologie des outils de gestion. Introduction à l'analyse sociale de l'instrumentation de gestion, Paris: La Découverte.
Cloutier, Charlotte, Gond, Jean-Pascal and Leca, Bernard (2017). Justifications, Evaluation and Critique in the Study of Organizations: An Introduction to the Volume” In Cloutier, Charlotte, Gond, Jean-Pascal and Leca, Bernard (Eds.), Justification, Evaluation and Critique in the Study of Organizations: Contributions from French Pragmatist Sociology (p. 3-29), Bingley, UK: Emerald Publishing Limited.
De Munck, Jean, and Zimmermann, Bénédicte (2014). Evaluation as Practical Judgment. Human Studies, 38(1), 113-135.
Dewey, John (1939). Theory of valuation. International Encyclopedia of Unified Science, 2(4), vii + 67.
Doganova, Liliana, Giraudeau, Martin, Helgesson, Claes-Fredrik, Kjellberg, Hans, Lee, Francis, Mallard, Alexandre, Mennicken, Andrea, Muniesa, Fabian, Sjögren, Ebba, and Zuiderent-Jerak, Teun (2014). Valuation Studies and the Critique of Valuation. Valuation Studies, 2(2), 87-96.
Dougherty, Christopher Nicholas (2019). Trust and transparency: Accreditation and impact reporting by Canadian charities. ANSERJ, 10(1), 6-25
Eckerd, Adam, and Moulton, Stephanie (2011). Heterogeneous Roles and Heterogeneous Practices: Understanding the Adoption and Uses of Nonprofit Performance Evaluations. American Journal of Evaluation, 32(1), 98-117.
Eisenhardt, Kathleen. M., and Graebner, Melissa E. (2007). Theory building from cases: Opportunities and challenges. Academy of Management Journal, 50(1), 25-32.
Espeland, Wendy Nelson, and Sauder, Michael (2007). Rankings and Reactivity: How Public Measures Recreate Social Worlds. American Journal of Sociology, 113(1), 1-40.
Eynaud, Philippe, and Mourey, Damien (2012). Professionnalisation et identité des associations du secteur social: chronique d’une mort annoncée? Politiques et management public, 29(4), 671-693.
Forbes, Daniel (1998). Measuring the Unmeasurable: Empirical Studies of Nonprofit Organization Effectiveness from 1977 to 1997. Nonprofit and Voluntary Sector Quarterly, 27(2), 183-202.
Fourcade, Marion (2011). Cents and Sensibility: Economic Valuation and the Nature of “Nature”. American Journal of Sociology, 116(6), 1721-1777.
Glassman, David M., and Spahn, Kathy (2012). Performance Measurement for Nonprofits. Journal of Applied Corporate Finance, 24(2), 72–77.
Greiling, Dorothea, and Stötzer, Sandra (2015). Performance Accountability as a Driver for Changes in Nonprofit–Government Relationships: An Empirical Insight from Austria. Voluntas, 26(5), 1690-1717.
Greatbanks, Richard, Elkin, Graham, and Manville, Graham (2010). The use and efficacy of anecdotal performance reporting in the third sector. International Journal of Productivity and Performance Management, 59(6), 571-585.
Grieco, Cecilia, Michelini, Laura, and Iasevoli, Gennaro (2015). Measuring value creation in social enterprises: A cluster analysis of social impact assessment models. Nonprofit and Voluntary Sector Quarterly, 44(6), 1173-1193.
Hall, Matthew (2014). Evaluation logics in the third sector. Voluntas, 25(2), 307-336.
Heuts, Frank, and Mol, Annemarie (2013). What Is a Good Tomato? A Case of Valuing in Practice. Valuation Studies, 1(2), 125-146
Jackson, Edward T. (2013). Interrogating the theory of change: evaluating impact investing where it matters most. Journal of Sustainable Finance & Investment, 3(2), 95-110.
Jagd, Søren (2011). Pragmatic sociology and competing orders of worth in organizations. European Journal of Social Theory, 14(3), 343-359.
Jarzabkowski, Paula, and Kaplan, Sarah (2015). Strategy tools‐in‐use: A framework for understanding “technologies of rationality” in practice. Strategic Management Journal, 36(4), 537-558.
Kail, Angela, and Lumley, Tris (2012). Theory of change. The beginning of making a difference. New Philanthropy Capital.
Kornberger, Martin (2017). The Values of Strategy: Valuation Practices, Rivalry and Strategic Agency. Organization Studies, 38(12), 1753-1773.
Lamont, Michèle (2012). Toward a comparative sociology of valuation and evaluation. Annual Review of Sociology, 38, 201-221.
Langley, Ann (1999). Strategies for theorizing from process data. Academy of Management Review, 24(4), 691-710.
Lecy, Jesse D., Schmitz, Hans Peter, and Swedlund, Haley (2012). Non-Governmental and Not-for-Profit Organizational Effectiveness: A Modern Synthesis. Voluntas, 23: 434-457.
Lum, Janet M, Shields, John, and Evans, Bryan (2016). Co-constructing Performance Indicators in Home and Community Care: Assessing the Role of NGOs in Three Canadian Provinces, ANSERJ, 7(1), 46-73
Luke, Belinda G., Barraket, Jo, and Eversole, Robyn (2013). Measurement as legitimacy versus legitimacy of measures- Performance evaluation of social enterprise. Qualitative Research in Accounting & Management, 10(3/4), 234-258.
Mailhot, Chantale, and Langley, Ann (2017). Commercializing Academic Knowledge in a Business School: Orders of Worth and Value Assemblages. In Cloutier, Charlotte, Gond, Jean-Pascal, and Leca, Bernard (Eds.), Justification, Evaluation and Critique in the Study of Organizations: Contributions from French Pragmatist Sociology (p. 241-269), Bingley, UK: Emerald Publishing Limited.
Martinus Hauge, Amalie (2016). The Organizational Valuation of Valuation Devices. Putting Lean whiteboard management to work in a hospital department. Valuation Studies, 4(2), 125-151.
Maier, Florentine, Schober, Christian, Simsa, Ruth, and Millner, Rainhard (2015). SROI as a method for evaluation research: understanding merits and limitations. Voluntas, 26(5), 1805-1830.
Manetti, Giacomo (2014). The role of blended value accounting in the evaluation of socio-economic impact of social enterprises. Voluntas, 25(2), 443-464.
Micheli, Pietro, and Kennerley, Mike (2005). Performance measurement frameworks in public and non-profit sectors. Production Planning & Control, 16(2), 125-134.
Millar, Ross, and Hall, Kelly (2013). Social return on investment (SROI) and performance measurement: The opportunities and barriers for social enterprises in health and social care. Public Management Review, 15(6), 923-941.
Moxham, Claire (2010). Help or hindrance? Examining the role of performance measurement in UK nonprofit organisations. Public Performance & Management Review, 33(3), 342-354.
Orlikowski, Wanda, and Scott, Suzan V. (2014). Exploring Apparatuses of Valuation in the Travel Sector. Organization Science, 25(3), 868-891.
Patriotta, Gerardo, Gond, Jean-Pascal, and Schultz, Friederike (2011). Maintaining legitimacy: Controversies, orders of worth, and public justifications. Journal of Management Studies, 48(8), 1804-1836.
Reinecke, Juliane (2010). Beyond a subjective theory of value and towards a ‘fair price’: an organizational perspective on Fairtrade minimum price setting. Organization, 17(5), 563-581.
Ruebottom, Trish (2011). Counting social change: outcome measures for social enterprise. Social Enterprise Journal, 7(2), 173-182.
Stark, David (2009). The sense of dissonance: Accounts of worth in economic life, Princeton University Press.
Stark, David. (2011). What’s valuable? In Aspers, Patrik and Jens Beckert (eds), The Worth of Goods: Valuation and Pricing in the Economy, Oxford University Press.
Yu, Stan, and McLaughlin, Darrell Arthur (2013). Program Evaluation and Impact Assessment in International Non-Governmental Organizations (INGOs): Exploring Roles, Benefits, and Challenges. ANSERJ, 4(2), 23-36
Copyright (c) 2020 Canadian journal of nonprofit and social economy research
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Submission of an original manuscript to the Canadian Journal of Nonprofit and Social Economy Research / Revue canadienne de recherche sur les OSBL et l'économie sociale [thereafter ANSERJ] will be taken to mean that it represents original work not previously published, that it is not being considered elsewhere for publication; that the author is willing to assign copyright to the journal as per a contract that will be sent to the author just prior to publication and, if accepted for publication, it will be published in print and online and it will not be published elsewhere in the same form, for commercial purposes, in any language, without the consent of the publisher.
The journal takes the stance that the publication of scholarly research is meant to disseminate knowledge and, in a not-for-profit regime, benefits neither publisher nor author financially. It sees itself as having an obligation to its authors and to society to make content available online now that the technology allows for such a possibility. In keeping with this principle, the journal will published all of its issues online.
Authors who publish in the ANSERJ agree to release their articles under the Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 International Licence (CC BY-NC-ND 4.0). This licence allows anyone to copy and distribute the article for non-commercial purposes provided that appropriate attribution is given. For details of the rights an author grants users of their work, please see the licence summary and the full licence.