Unintended outcomes and impact measurement

Peoplewhocare I had the pleasure of visiting the SSE programme in Wigan and Leigh last week, to facilitate an ‘introduction to social impact measurement’ session with the students on the programme. I do love that experience of arriving in on a train to a place you’ve never been before, wandering down the road to a building, following the signs….and finding an SSE programme there just like the ones across the network.

I think the session went pretty well: great to meet the students and their projects at different stages, and help them think about the story that lies behind their work (aka ‘theory of change’), what tools and methodologies to think about using, and how much time and resources to commit to evaluation at this stage of their work. I like the process because on the one hand it challenges you to put numbers and objectives to the activity you are thinking of doing (and to what tangible difference you hope to make), and on the other it forces you to take your head out of the day-to-day of delivery and think about the broader context and overall story. Both timely and relevant activities for early-stage social entrepreneurs as they plan, work on communications, and set up systems and processes.

In the course of the couple of hours, before heading across to Liverpool SSE’s steering group meeting, we discussed ‘unintended outcomes’ as well: being open and alive to positive and negative effects that might not have been part of the original plan. They told me of a perfect example (which I’m reporting second-hand): how one Liverpool SSE student became Facebook friends with another one on the programme; via that network and a couple of conversations, he identified that this SSE student lived near his ex-partner and, as a result, close to his son…who he hadn’t seen for almost 18 years. He was able to get back in touch, and, in an appropriate tying up of loose ends, his son then attended his father’s SSE graduation.

Unintended indeed, but a great outcome. :0)

Share Button

Brief thoughts on the Social Impact Bond (and the future of funding)

Bond
Yesterday I found myself at NCVO listening (and responding) to draft recommendations from their Funding Commission, which is looking at funding in the sector for the next 10 years. I won't dwell too much on that, but would recommend reading the Emerging Recommendations paper to inform your thinking for the short and long-term.

Social investment and bringing private / commercial / new sources of money into the sector both feature amongst its pages, and the Social Impact Bond (SIB) is also named as one of the financial models that might helpe achieve this. It is an ingenious model, that encourages private and social investment (through social AND financial return), mitigates risk (and upfront investment) for government, and provides that crucial upfront money for the providers in question. And it focuses the sector, quite rightly in my view, on measurement and proving their impact: delivering outcomes they say they will.

Today is the official start of the first pilot, which will tackle reoffending in Peterborough which has been widely covered in the media this morning: nice to hear the sector on Radio, TV and in the mainstream press. And one hopes it is a great success.

At NCVO, I happened to find myself opposite Toby Eccles from Social Finance the organisation behind the bond pilot. So I took the opportunity to ask my main question on SIBs, which I previously raised in our Big Society recommendations paper (pdf), which is "what about the less-easily monetisable outcomes, particularly those (such as social capital, trust, confidence etc) which are crucial to the Big Society agenda?" The risk being that this new money focuses on the easily quantifiable / monetisable stuff (for returns etc), at a time when funding and investment is shrinking across the board.

Toby rightly pointed out that they had to prove the concept, and do it with a fairly chunk-able, solid area (reoffending is such an area where costs, savings etc are easy to quantify) before moving on to other more complex and nuanced areas in a few years. And that SIBs are only one part of the piece. Which makes a lot of sense to me, and I hope that SSE and others can engage and participate in helping forge + create new SIBs (and other financial models) in other relevant areas of social policy.

The challenge, as I see it, is two-fold.

One is that "in a few years" might be a timescale that doesn't stack up in the current climate for a whole range of organisations, if government puts emphasis on this particular model (which is so attractive in the current economic circumstances). Particularly if the Big Society Bank, as the NCVO recommendations currently say, is primarily used to help underwrite these new models. Because, as the recommendations also make clear, there are also other crucial areas that need investment or attention: financial literacy (including investment readiness), early-stage grants (a la Communities First etc), impact-first investment of other types, increasing entrepreneurialism, skills for scaling/trading, attracting philanthropy and corporate support in other ways, and so on and so forth.

Secondly, therefore, how do we ensure that the various funding initiatives and funders (Big Society Bank, Big Local Trust + other Big Lottery programmes, Communities First, Social Impact Bonds, Venturesome, UnLtd, venture philanthropy, trusts + foundations etc etc) are complementary and meeting as many of those needs as possible, in the toughest climate in years? And in the years to come.

From the recommendations, and those thoughts, I take a few things away: as practitioners, social entrepreneurs and social enterprises, we can: measure impact better (more robustly, transparently, quantifiably as possible), improve our understanding of different types of donors (and the quality of asking + relationship management), increase our knowledge and understanding of finance (and of those we work with), and engage in the conversation about new financial models.

Which should be enough to keep me going for now…..

Share Button

Deep impact: the how, who and why of social enterprise measurement

MeasureIt was a full day of impact measurement on Wednesday this week. Which for an evaluation + metrics geek such as myself, is a day of utter joy….

First up, I did my "Introduction to social impact measurement" workshop with the new SSE Cornwall cohort of social entrepreneurs. The starting point for us is to help them get a full understanding of the story of how they make a difference (their "theory of change"), before diving into indicators, tools and methodologies. As well as demystifying some of the measurement jargon…

What's always interesting about the process of mapping that story out (a methodology unapologetically cribbed + developed from the new economics foundation) is that it is also an incredibly useful planning tool, and also leads to better communication of the project or idea. The message I emphasised was the importance of measurement in the current climate: funding or investment or contracts without strong evidence will be extremely scarce. So it is more crucial than ever. And there are no excuses for not measuring our social impact; a point I was also making in this video (quickly!) at Chain Reaction's Stronger Communities get-together on the Big Society.


Having come back from Penzance on the longest-train-journey-in-the-world (possibly), I headed down to the Garden Museum for the SE100 awards event, wondering who would win. Read more about the winners and the event here. It is an excellent initiative which recognises growth in turnover, but also has impact measurement built into its very core. Congrats to Mow and Grow, FRC Group and Create Leeds, and to all the nominees. And congrats to Tim West and the team at Social Enterprise Mag (along with all their various partners + sponsors) for pioneering the index. As Doug Richard noted in his closing words, when a sector or movement has an index, it's getting serious. And for me, an important development to have the recognition of awards tied to demonstrable evidence and proof of success: again, incentivising others to grow their impact, and measure that impact. Which, as Peter Holbrook and Nick Hurd said, is exactly what will be required in the current economic situation. I'm hopeful that some of those Cornwall SSE students, and others around the UK, will be applying for the trailblazer award next year.

It is well worth reading the full SE100 documentation, which includes some interesting discussions about the Future Jobs Fund (which was crucial to Mow and Grow's growth), regional breakdown of the 100 organisations, and several really good practical case studies of how impact can be grown and measured.


Finally, it was interesting to note the announcement on the same day by Nick Hurd of the end of Futurebuilders in its current form. Future revenue from the fund (i.e. in loan repayments) will be used to give grants to stimulate the creation of groups and initiatives at a local + neighbourhood level; to be called "Communities First", according to a speech by Francis Maude. On the one hand, I largely agree with this decision: in the manifesto pulled together by social entrepreneurs and social entrepreneur support agencies, we called for freer, direct local investment in locally-based social entrepreneurs through seedcorn grants and support (see here for detail); we recommended this because "many start-up and fledgling social entrepreneur-led initiatives are
responding to needs in their own communities not being met by any
current, commissioned public service provision"
and that freer local investment is key to "encouraging innovation, active citizenship, and devolution of power"; I think this has much crossover with what is being proposed.

On the other hand, as we're discussing impact, the evaluation of Futurebuilders is worth a look (full report pdf here). Reading it for me, I don't think there's much doubt that it became more efficient, in its second incarnation, at giving out funds and selecting appropriate organisations for those loans (conversion rate, disbursement etc). Indeed, the evidence for impact on organisations' financial health and ability to deliver public services is strong; that for social returns and outcomes much less so. And there are some strong findings about the fact that these were new, 'unbankable' loans not being made elsewhere, providing new capital (i.e. they were highly 'additional')

Around 19% of loans went to smaller organisations (income under £100k) which is higher than I thought. Though it is interesting to also see that those organisations only won 10% of the contracts that FB investors gained (large orgs with turnover over £1m gained 46% of contracts by value). One assumes that all this has been fed into the decision-making process, otherwise (in effect), why do it: certainly, the evaluation's conclusion notes that social investment of this type will have to be looked at again in the context of more constrained social finances. And it is perhaps a decision also as much about policy emphasis (on social capital, community responsibility, and so on, as opposed to a relatively restricted version of 'public service delivery contracts') as about the type of investment (grant rather than loan). It will be fascinating to see what form the Big Society Bank takes, which Nick Hurd has stated is top of his agenda, and how it builds on all the experimentation and experience of the full range of social investors, including Futurebuilders.

Share Button