Unintended outcomes and impact measurement

Peoplewhocare I had the pleasure of visiting the SSE programme in Wigan and Leigh last week, to facilitate an ‘introduction to social impact measurement’ session with the students on the programme. I do love that experience of arriving in on a train to a place you’ve never been before, wandering down the road to a building, following the signs….and finding an SSE programme there just like the ones across the network.

I think the session went pretty well: great to meet the students and their projects at different stages, and help them think about the story that lies behind their work (aka ‘theory of change’), what tools and methodologies to think about using, and how much time and resources to commit to evaluation at this stage of their work. I like the process because on the one hand it challenges you to put numbers and objectives to the activity you are thinking of doing (and to what tangible difference you hope to make), and on the other it forces you to take your head out of the day-to-day of delivery and think about the broader context and overall story. Both timely and relevant activities for early-stage social entrepreneurs as they plan, work on communications, and set up systems and processes.

In the course of the couple of hours, before heading across to Liverpool SSE’s steering group meeting, we discussed ‘unintended outcomes’ as well: being open and alive to positive and negative effects that might not have been part of the original plan. They told me of a perfect example (which I’m reporting second-hand): how one Liverpool SSE student became Facebook friends with another one on the programme; via that network and a couple of conversations, he identified that this SSE student lived near his ex-partner and, as a result, close to his son…who he hadn’t seen for almost 18 years. He was able to get back in touch, and, in an appropriate tying up of loose ends, his son then attended his father’s SSE graduation.

Unintended indeed, but a great outcome. :0)

Share Button

Deep impact: the how, who and why of social enterprise measurement

MeasureIt was a full day of impact measurement on Wednesday this week. Which for an evaluation + metrics geek such as myself, is a day of utter joy….

First up, I did my "Introduction to social impact measurement" workshop with the new SSE Cornwall cohort of social entrepreneurs. The starting point for us is to help them get a full understanding of the story of how they make a difference (their "theory of change"), before diving into indicators, tools and methodologies. As well as demystifying some of the measurement jargon…

What's always interesting about the process of mapping that story out (a methodology unapologetically cribbed + developed from the new economics foundation) is that it is also an incredibly useful planning tool, and also leads to better communication of the project or idea. The message I emphasised was the importance of measurement in the current climate: funding or investment or contracts without strong evidence will be extremely scarce. So it is more crucial than ever. And there are no excuses for not measuring our social impact; a point I was also making in this video (quickly!) at Chain Reaction's Stronger Communities get-together on the Big Society.


Having come back from Penzance on the longest-train-journey-in-the-world (possibly), I headed down to the Garden Museum for the SE100 awards event, wondering who would win. Read more about the winners and the event here. It is an excellent initiative which recognises growth in turnover, but also has impact measurement built into its very core. Congrats to Mow and Grow, FRC Group and Create Leeds, and to all the nominees. And congrats to Tim West and the team at Social Enterprise Mag (along with all their various partners + sponsors) for pioneering the index. As Doug Richard noted in his closing words, when a sector or movement has an index, it's getting serious. And for me, an important development to have the recognition of awards tied to demonstrable evidence and proof of success: again, incentivising others to grow their impact, and measure that impact. Which, as Peter Holbrook and Nick Hurd said, is exactly what will be required in the current economic situation. I'm hopeful that some of those Cornwall SSE students, and others around the UK, will be applying for the trailblazer award next year.

It is well worth reading the full SE100 documentation, which includes some interesting discussions about the Future Jobs Fund (which was crucial to Mow and Grow's growth), regional breakdown of the 100 organisations, and several really good practical case studies of how impact can be grown and measured.


Finally, it was interesting to note the announcement on the same day by Nick Hurd of the end of Futurebuilders in its current form. Future revenue from the fund (i.e. in loan repayments) will be used to give grants to stimulate the creation of groups and initiatives at a local + neighbourhood level; to be called "Communities First", according to a speech by Francis Maude. On the one hand, I largely agree with this decision: in the manifesto pulled together by social entrepreneurs and social entrepreneur support agencies, we called for freer, direct local investment in locally-based social entrepreneurs through seedcorn grants and support (see here for detail); we recommended this because "many start-up and fledgling social entrepreneur-led initiatives are
responding to needs in their own communities not being met by any
current, commissioned public service provision"
and that freer local investment is key to "encouraging innovation, active citizenship, and devolution of power"; I think this has much crossover with what is being proposed.

On the other hand, as we're discussing impact, the evaluation of Futurebuilders is worth a look (full report pdf here). Reading it for me, I don't think there's much doubt that it became more efficient, in its second incarnation, at giving out funds and selecting appropriate organisations for those loans (conversion rate, disbursement etc). Indeed, the evidence for impact on organisations' financial health and ability to deliver public services is strong; that for social returns and outcomes much less so. And there are some strong findings about the fact that these were new, 'unbankable' loans not being made elsewhere, providing new capital (i.e. they were highly 'additional')

Around 19% of loans went to smaller organisations (income under £100k) which is higher than I thought. Though it is interesting to also see that those organisations only won 10% of the contracts that FB investors gained (large orgs with turnover over £1m gained 46% of contracts by value). One assumes that all this has been fed into the decision-making process, otherwise (in effect), why do it: certainly, the evaluation's conclusion notes that social investment of this type will have to be looked at again in the context of more constrained social finances. And it is perhaps a decision also as much about policy emphasis (on social capital, community responsibility, and so on, as opposed to a relatively restricted version of 'public service delivery contracts') as about the type of investment (grant rather than loan). It will be fascinating to see what form the Big Society Bank takes, which Nick Hurd has stated is top of his agenda, and how it builds on all the experimentation and experience of the full range of social investors, including Futurebuilders.

Share Button