A Guide to Actionable Measurement

How organizations make decisions has begun to garner more of my interest as I delve further into the murky undertow of impact measurement.  Recently, I came across  A Guide to Actionable Measurement (17 pages) offering a glimpse into what influences resource and fund allocation at the Bill and Melinda Gates Foundation.  It’s clear. It’s succinct.  It’s different.

To begin, they actually articulate why they are evaluating and how the data will be used.

Our philosophy and approach emphasize measurement done for a specific purpose or action. We recognize the most elegant evaluation is only meaningful if its findings are used to inform decisions and strengthen our work to improve people’s lives.

Our approach is driven by three basic principles: 1) Measurement should be designed with a purpose in mind — to inform decisions and/or actions; 2) We do not measure everything but strive to measure what matters most; 3) Because the foundation’s work is organized by strategies, the data we gather help us learn and adapt our initiatives and approaches.”  (Actionable Measurement Guide Cover Letter)

Being able to create impactful interventions to complex problems relies on informative evaluation striking an effective balance between learning (improving something) and accountability (proving something).   Both are needed and valuable for understanding how and why an intervention is effective or ineffective.

At present we are super-proficient at accountability evaluation.  How many?  How often?  Numbers in a spreadsheet.

Unfortunately our evaluation efforts often fail to make meaning from the numbers.   In what ways did reaching the target make a difference?   How did the intervention ‘move the needle’ on the problem it is trying to address? 

Putting together an evaluation approach designed to answer these deeper questions can be stymied by the overwhelming feeling of not knowing where to start or the tendency to build something unnecessarily complicated.  Combing through the Guide to Actionable Measurement has revealed a few tips.

Begin by looking at the language being used to describe the evaluation approach.   The Foundation is intentional about including phrases like ‘strategic intent‘, ‘theory of action‘, and ‘actionable measurement‘.  As an example, using strategic intent over strategic plan has an indelible influence on how the strategy is developed, deployed and measured.

Another manageable place to start is The Actionable Measurement Matrix (Exhibit 4, Page 6 of The Guide). It’s an example of how an illustrative visual can connect activities of a single intervention to the broader strategic intent being deployed to address a complex problem.

Finally, the Bill and Melinda Gates Foundation is careful to acknowledge and measure its role in the creation of the problem being addressed.. Externally, they want to know how their activities as an advocate for policy change have impacted the issues they are try to influence.  Internally, they want to know how their interactions with grantees have impacted interventions and ultimately the problem being addressed.

Etmanski: Set the Table for Allies, Adversaries and Strangers

Have you ever been asked to participate on a committee or in a community meeting and left wondering why were invited?  A situation in which the conversation was swirling around you but you never quite knew how to contribute to it?

Looking back to the occasions in which this was the case for me, I realize the people calling the meeting (conveners) had a broad range of reasons for inviting people (job titles, organizations, to not hurt feelings, to get things done, to access resources, for expertise, to make new connections, because they were told to, and so on).  All of which are valid reasons but it was unclear why I had been invited so I contributed little.

As a convener, we need to be deliberate and thoughtful about the people we invite and the environment in which they gather.  Remember, to have the idea picked up by the mainstream, means inviting supporters, opponents and others beyond the immediate context.  Everyone needs to feel welcome and to be assured that their contributions will be valuable and important.

 

Four Characteristics of Effective Convening

To avoid the gathering in which a few people speak and nothing is ultimately accomplished, take a minute to run through the questions below.

  • Civility” – Has the group crafted (agreed upon) ground rules of conduct by which they can respectfully, openly, and safely contribute?
  • Personal Agency” – As the convener, have you encouraged the best from all participants?  Have you given each participant an opportunity to shine, show their strengths and lead in their own way?
  • Hospitality” – As the convener, are you able to articulate the importance of each participant’s contribution and made them feel like they belong?
  • Curiosity” – As a convener, have you created a group culture in which uncertainty leads to inquiry and eventually new answers?

 

Impact: Six Patterns to Spread Your Social Innovation by Al Etmanski is a guide for social innovators to move their idea from localized success to broader systemic impact.

Etmanski: Create a Container for Your Content

Being on the Board of Skills Society, I find myself wondering how we might get our message beyond our immediate community of supporters.  A common problem confronting most not-for-profit originations.

 

How do we get people to care about something that doesn’t really matter to them?

 

 There are lots of strategies.  The Elevator Pitch.  The One-Pager.  The Brand Message.  The Narrative.  Social Media Strategies.  Flashy Brochures.  All of these are effective to a certain point.  However,  how can the message a person hears be converted into an action they take?

 

For Etmanski, “Presenting the right content in the right container makes it easier for people to do the right thing” (p.64).   For impact beyond the local context, the message needs to inspire people beyond your community of supporters to  contribute to the million small acts of the movement.

 

5 Characteristics of Effective Containers

I crafted questions to  help you evaluate your message and its ability to reach beyond your community of supporters.

  • They are playful and fun.” – Does your message make people feel good?
  • They are non-judgmental” – Does your message blame or guilt the people you are trying to reach?
  • They ignite our imaginations” – Does your message inspire people to think about what is possible?
  • They personalize the abstract” – Does your message articulate how the issue is connected to the people you are trying to reach?
  • They tell a story” – Does your message have characters and a plot?

 

After running your message through Etmanski’s tips, I would encourage you to ask yourself one more question; does your message still have the ring of authenticity or does it feel contrived?

 

Impact: Six Patterns to Spread Your Social Innovation by Al Etmanski is a guide for social innovators to move their idea from localized success to broader systemic impact.