A world of evidence … but can we trust that it is any good?

What is good evidence? And how can policymakers and decisionmakers decide what is working and what isn’t, when it comes to deciding where public money is spent and how?

These are the kinds of questions that models and tools such as randomised controlled trials and cost-benefit analysis attempt to answer. The government has also supported the development over the last five years of the What Works Network, which now consists of 10 independent What Works Centres. When talking about impact there’s also been a move to capturing and recognising the value of qualitative data.

As one of our key aims is to support and facilitate the sharing and use of evidence in the public sector, we were interested to read a new publication ‘Mapping the standards of evidence used in UK social policy’.

Standards of evidence

Produced by the Alliance for Useful Evidence, the research has found 18 different Standards of Evidence currently in use across UK social policy.

The report notes that over the last decade there has been increasing interest in grading effectiveness or impact against a level or scale. Typically, the higher up the scale, the more evidence is available. Theoretically this means that decision-makers can have higher confidence in deciding whether a policy or intervention is working.

While all the evidence frameworks generally aim to improve the use of evidence, the different goals of the organisations responsible can shape the frameworks in different ways. They can be used to inform funding decisions, to make recommendations to the wider sector about what works and what doesn’t, or as a resource to help providers to evaluate. And unfortunately this means that the same intervention can be assessed differently depending on which framework is used.

The Alliance for Useful Evidence concludes that while a focus on evidence use is positive, the diversity of evidence standards risks creating confusion. Suggested options for improving the situation include introducing an independent accreditation system, or having a one-stop shop which would make it easier to compare ratings of interventions.

Dissemination and wider engagement

The question of standardising evidence frameworks is just one part of a wider effort to increase transparency. As well as collecting evidence, it’s important that when public money has been invested in carrying out evaluations and impact assessments, that this evidence remain accessible over the longer term and that lessons are learned. It can often seem that government departments have very short organisational memories – especially if they’ve suffered a high churn of staff.

Two projects which we support in Scotland are focused on increasing the dissemination and awareness of evaluation and research evidence. Research Online is Scotland’s labour market information hub. Produced by ourselves and Skills Development Scotland, the portal brings together a range of statistics and research and acts as the centre of a community of practice for labour market researchers, practitioners and policy-makers.

Meanwhile Evaluations Online is a publicly accessible collection of evaluation and research reports from Scottish Enterprise. The reports cover all aspects of Scottish Enterprise’s economic development activities – some of the latest added to the site cover megatrends affecting Scottish tourism, innovation systems and the gender gap, and the commercial flower-growing sector in Scotland.

When working within the policy world it can be easy to suffer from fatigue as ideas appear to be continually recycled, rejected and then revisited as policy fashions change and political parties or factions go in and out of power. The spotlight, often driven by the media, will shine on one hot policy issue – for example, moped crime, cannabis legislation or health spending – and then move on.

Online libraries of evaluations and research reports are one tool which can help support a longer-term culture of learning and improvement within the public sector.

Evidence Week 2018

Inspired by similar objectives, Evidence Week runs from 25th to 28th June 2018 and aims to explore the work of parliamentarians in seeking and scrutinising evidence. It will bring together MPs, peers, parliamentary services and the public to talk about why evidence matters, and how to use and improve research evidence.

This may be the start of wider knowledge sharing about standards of evidence, to help those using them to improve their practice.


The Knowledge Exchange is a member of the Alliance for Useful Evidence. Our databases are used by government and the public sector, as well as private-sector consultancies, to keep abreast of policy news and research in social and public policy.

Buurtzorg: reinventing district nursing in Scotland

Buurtzorg roughly translates from its native Dutch as “neighbourhood care”. The model, used extensively in the Netherlands, has attracted international attention as a novel way to deliver community based nursing programmes. Its positive reputation and recorded successes in areas of Holland are attributed to its innovative use of locally-based and locally-aware nursing teams to deliver high-quality person-centred, but low-cost, care.

Seeking to improve core health outcomes

In the Netherlands, Buurtzorg was designed to engage three key health priorities:

  • Health promotion
  • Effective management of conditions (in a community setting)
  • Disease prevention

It focused particularly on the elderly, those who move regularly between hospital and home, and those with long term, constant care illnesses. It has also been used with patients with progressive illnesses such as dementia, with some nurses within the teams being given training to become dementia specialists where appropriate.

The model includes the following key elements:

  1. Holistic and personalised care – where assessments of need are integrated into and form the foundation of agreed care plans
  2. Mapping networks of informal care, and assessing ways to involve these networks in treatment plans
  3. Identifying other formal carers and organisations who provide care services and coordinate their input
  4. Taking steps to support the client in his/her own environment
  5. Promoting self-care and independence on the part of patients.

A number of studies of pilot sites across the UK and beyond have identified the positives and some challenges of applying the Buurtzorg model in different contexts. Some of these are outlined in the table below.

Applying the model in Scotland

In a Scottish context, the model has been applied in a number of areas, with the initial pilots making way for a wider roll out of adaptations of the model. In March 2017, as part of a wider research project, nurses and management staff from NHS boards across Scotland met in Perth to discuss learning and exchange best practice around how the model could be adapted and further rolled out in the future.

It highlighted the different stages that many Buurtzorg areas were at in their roll out, with some like Aberdeen and the Borders far more established than Argyll, who were at the time only in the earliest stages of their Buurtzorg journey. The research and learning event gave practitioners the opportunity to engage and further cement both formal and informal learning networks, which have been identified as key to the success of the Buurtzorg model both in the UK and elsewhere.

The importance of information sharing and informal learning

Rolling out the model in test sites highlighted the importance of planning and learning, and of creating a strong sense of trust between practitioners and NHS management, but also between the Buurtzorg nurses and their service users and other professionals. This change in mindset regarding ways of working, and a change in the chain of accountability was something, which, according to those practitioners who attended the Perth event, many sites have found to be a significant barrier to effective implementation.

However it was also highlighted that promoting and facilitating the creation of formal and informal learning networks and learning spaces can be an effective way to generate conversation about best practice as well as allaying some fears that may persist regarding working culture and approaches, including partnership working with other agencies and understanding risk in the working environment.

In Scotland, approaches have varied, from encouraging nursing teams to create videos and then post them to an online forum, employing more formal training plans to incorporate multiple agencies and ensure that everyone is “singing from the same hymn sheet”, or holding informal drop-in or open space events where staff are supported in their role and given advice to alleviate and find potential solutions to issues.

Practitioners also highlighted that it is important to provide a space where teams can examine what did not work well, and why. Learning from mistakes can often be as beneficial as learning from good practice, as these can provide insights into issue management and resolution as well as how to implement the programme effectively.

It is also clear from feedback, that while a strong core network of nurses and other community based practitioners is vital to the success of Buurtzorg care models, the back team support is also just as important. Creating efficient and streamlined processes leaves nursing teams free to care for patients and allows them more time to develop and deliver the person-centred care which is a key element of the Buurtzorg model.

Final thoughts

Learning from the experiences of the trial projects in Scotland has provided invaluable insights on how the model can be applied and some of the challenges that can be encountered because of the differing context. This knowledge can then be used to shelter and steer newer projects away from danger areas toward best practice and innovative collaborative working. Applying Buurtzorg in Scotland gives the potential to create and implement new models of holistic person-centred care, where practitioners with local and specialist knowledge interact at a local level with other care providers, join up approaches and create a better care experience for service users.

Follow us on Twitter to see what developments health, social and community care are interesting our research team.

If you enjoyed this blog, you may also be interested in our other articles on health care and reablement care