Beyond Vanity Metrics: Measuring Real Impact

Most social impact leaders think they’re measuring their impact — but are they really? 

Measuring impact is especially difficult when change happens over years or even decades, and when the outcomes are tied to complex, systemic issues. On top of that, the process of evaluation and measurement can feel like extra work — another task on an already full plate. 

But without it, we risk relying on anecdotes and vibes instead of real data to prove we’re making a difference.

In this episode, Eric and Jonathan break down:

• The difference between evaluation and measurement
• Why tracking the wrong metrics can hurt your mission
• How to measure impact without faking it. 
• Three critical pillars of impact evaluation
• How to avoid the pitfalls of mission creep while staying focused on what your organization does best.

If you’re struggling to track the real impact of your work — or wondering how to balance storytelling with hard data — this conversation is for you.

Episode Highlights:

[00:00] Why Impact Evaluation Is So Hard

• Measuring success isn’t just about external outcomes—it’s about internal sustainability too.
• Why some nonprofits don’t track their impact (and why that’s a problem).

[01:22] Evaluation vs. Measurement: What’s the Difference?

• Evaluation = the big picture. Measurement = the tools.
• Why confusing the two can lead to misleading conclusions.

[03:50] The Challenge of Proving Long-Term Impact

• "That impact story took 20 years—how do you measure it in year two?"
• How to identify leading indicators that show progress before the full impact is realized.

[12:48] The Mission Creep Trap: Why Nonprofits Lose Focus

• The risk of trying to "fix everything" instead of doubling down on what you do best.
• How social impact leaders can take a page from academic research to avoid spreading too thin.

[15:39] Measuring Internal Sustainability: The Missing Piece

• If your organization is burning out, your impact won’t last.
• The three critical pillars of evaluation every nonprofit should track.

[23:46] A Simpler Way to Measure Success

• "Look, this doesn’t have to be complicated. Pick three things. Track them. Get better over time."
• How to integrate measurement into your culture—without hiring expensive consultants.

Resources:

• Article - Beyond Aesthetics: The ROI of Brand Building
• Article - Prove it or Lose it: Why Proof of Impact Matters in the Social Impact Space

Listeners, now you can text us your comments or questions by clicking this link.

*** If you liked this episode, please help spread the word. Share with your friends or co-workers, post it to social media, “follow” or “subscribe” in your podcast app, or write a review on Apple Podcasts. We could not do this without you!

We love hearing feedback from our community, so please email us with your questions or comments — including topics you’d like us to cover in future episodes — at [email protected]

Thank you for all that you do for your cause and for being part of the movement to move humanity and the planet forward.