Shining a spotlight on Evaluations Online: Scotland’s essential economic development resource

Image: Marcus Winkler (via Unsplash CC)

The UK is currently at the beginning of what is expected to be the deepest recession in living memory. From a policy point of view, governments around the world are facing the daunting task of navigating a route through uncharted territory. As the recently launched cross-institutional Economics Observatory noted last month, “sound and non-partisan advice is needed to inform decision-makers across all parts of society, about the choices they face in dealing with the crisis and the recovery”.

Key role of economic development and sustainability in the Covid-19 recovery

As statistical analysis suggests that Scotland’s GDP fell 18.9% during the month of April, and that in May output remains 22.1% below the level in February, the need for a recovery approach that is based on empowering regions, cities and local communities is clear.

The independent Advisory Group established by the Scottish Government to advise on Scotland’s economic recovery in the wake of the COVID-19 pandemic, published its report at the end of June. This identified interventions to support Scotland’s economic recovery within the context of the strategic goal of shifting to a greener, fairer and more inclusive economy with wellbeing at its heart.

New economic development initiatives and programmes in response to the pandemic have already been launched in Scotland. Some are focusing on helping specific sectors such as tourism and the creative industries. There is also a recognition that it is important during the recovery to build on current strengths, such as inward investment and low-carbon technologies.

What works in economic development

Here at the Knowledge Exchange, we’re committed to supporting the use of evidence to inform policy development and practice. So in the light of the current importance of economic development, we thought we’d highlight a useful resource which makes available the results of evaluation work and research in order to enhance decision-making and investment in the future.

Evaluations Online is a public portal providing access to a collection of evaluation and economic development research reports commissioned by Scottish Enterprise, Scotland’s main economic development agency.

Ensuring that public investment generates economic and social benefits, and long-term inclusive growth for Scotland is core to Scottish Enterprise’s remit. Making evaluation and research reports publicly available supports this aim, as well as ensuring transparency.

Established for over a decade, the site now contains over 750 research and evaluation reports dealing with different aspects of economic development activity, such as business support, investment, sector growth and improving skills. All of the reports are publicly accessible and free to access.

Learning lessons from previous programmes

Developing the economic response to Covid-19 is happening at a much faster pace than usual policy-making cycles. It is important, though, that spending and investment is focused on areas that will have most impact, and will also contribute to the overall goals of supporting jobs, protecting and progressing education and skills, and tackling inequality. Considering lessons from previous interventions when commissioning new projects or allocating funding, is one way to address effectiveness.

It’s worth repeating that repositories of evidence can help bring about better policy in a number of ways:

  • improving accountability by making it easier for people to scrutinise the activities and spending of public sector organisations;
  • improving the visibility and therefore the impact of evidence;
  • helping identify gaps in evidence by making it easier to compare research findings; and
  • increasing our understanding of what works (‘good practice’), not only in the activities covered, but also in evaluation and research methods.

Evaluations Online offers resources in key areas such as entrepreneurship, regeneration, social enterprise, economic inclusion, skills development, financing, inward investment and commercialisation, as well as by sector. In recent years, questions about inclusive growth and generating social value have also become more important policy issues.

Some of the most popular recent reports added to the site have focused on:

It’s clear that there are huge sectoral and regional challenges within the economy which will need faced immediately and in the longer term, as a result of Covid-19. Business practices have changed, as have all our lives. But we believe that the use of evidence and research will be fundamental in successful recovery and the transition towards a greener, net-zero and wellbeing economy.


The Knowledge Exchange work with Scottish Enterprise to manage the Evaluations Online portal.

Evaluations Online is a publicly accessible collection of evaluation and research reports from Scottish Enterprise. The reports cover all aspects of Scottish Enterprise’s economic development activities and are available for download at no cost.

Research Online: an expert source of information on the Scottish labour market

ro-pic

One of the Knowledge Exchange’s key aims is to support the use of evidence and research in public policy and practice. Our Information Service database has been recognised by the Alliance for Useful Evidence in its Evidence Ecosystem which illustrated the diversity of organisations involved in supporting evidence use in the government and public sector. But we also support two other sector-specific research portals – Research Online and Evaluations Online.

Here we introduce Research Online, which first launched over 14 years ago and which we have worked with Skills Development Scotland to develop and update ever since.

Scottish labour market intelligence

Research Online is Scotland’s labour market hub. The portal provides an authoritative source of labour market research and analysis relevant to Scotland and supports evidence-based policy making in the Scottish labour market.

Before Research Online was created, research suggested that although useful labour market research and analysis was undertaken within Scotland by a large range of organisations, there was no single dissemination source.

Therefore, a requirement existed for a portal that clearly identified current labour market intelligence (LMI), provided a common understanding of current gaps and provision in areas including labour supply and skills, and focused action to ensure LMI met Scottish user needs.

Research Online was conceived to improve access to this wealth of intelligence.

The most comprehensive collection of labour market intelligence

The portal now contains thousands of documents on a range of labour market topics including:

  • Employment;
  • Skills and training;
  • Unemployment;
  • Entrepreneurship;
  • Vocational education and training;
  • Workforce development; and
  • Equal opportunities.

The material available on the portal includes research, policy, analysis, discussion and sectoral and geographic profiles. Our team sources the latest research and policy documents from a wide range of sources, including academic journals, government departments and agencies, labour market research centres and material sent in directly by key organisations in Scotland and the wider UK. The available material includes grey literature, government policy and up-to-date academic research.

Research Online also incorporates a current awareness service that alerts registered users to new material on a fortnightly basis. It also has integrated reading list functionality.

Free to access

Research Online can be accessed by anyone, free of charge. You can browse the material here without registering, as well as create reading lists to be accessed at a later date or shared with colleagues.

If you would like to sign-up for a range of current awareness alerts that keep you up to date on a variety of labour market topics, covering both Scotland and the wider UK, you can do so here.

Our shared vision is for Research Online to be recognised as a key dissemination mechanism by Scotland’s producers of labour market intelligence and to be at the centre of a community of practice for labour market researchers, practitioners and policy-makers.


You can find out more about the projects The Knowledge Exchange team has been involved in, and the consultancy services we offer, here.

Focus on: Evaluations Online

 

Evaluations Online is a public portal providing access to a collection of evaluation and economic development research reports commissioned by Scottish Enterprise, Scotland’s main economic development agency.

Ensuring that public investment generates economic and social benefits, and long-term inclusive growth for Scotland is core to Scottish Enterprise’s remit. Making evaluation and research reports publicly available, supports this aim as well as ensuring transparency.

Some of the most popular recent reports added to the site have focused on:

Working in partnership

Since 2007, Idox has been working with Scottish Enterprise to deliver Evaluations Online using a publishing platform designed specifically to deal with research material. Users can easily navigate to and assess the relevance of material thanks to specially-written abstracts and structured search functions based on a bespoke classification and record structure.

The site now contains over 600 evaluation and research reports commissioned by Scottish Enterprise, dealing with different aspects of economic development activity such as business support, investment, sector growth and improving skills. All of the reports are publicly accessible and free to access.

Since the site launched we have continued to refresh and improve the site, ensuring it better meets the needs of key user groups, including economic development policy-makers and practitioners across Scotland. In the last quarter of 2016, the reports hosted on the site were accessed over 30,000 times.

The importance of evaluation

We’ve highlighted the importance of evidence and evaluation and assessment of information quality on the blog several times before. It’s worth repeating that repositories of evidence can help bring about better policy in a number of ways:

  • improving accountability by making it easier for people to scrutinise the activities and spending of public sector organisations – this helps organisations meet Freedom of Information responsibilities;
  • improving the visibility and therefore the impact of evidence;
  • helping identify gaps in evidence by making it easier to compare research findings; and
  • increasing our understanding of what works (‘good practice’), not only in the activities covered, but also in evaluation and research methods.

We’re proud to support Scottish Enterprise in the dissemination of their evaluation and research output, through a portal which they believe increases the return on these activities.


You can find out more about the projects The Knowledge Exchange team has been involved in, and the consultancy services we offer, here.

Evaluations Online: evaluating economic development activity in Scotland

by Stacey Dingwall

Recently we profiled Research Online, one of the two research portals managed by the Knowledge Exchange team. In this blog, we focus on Evaluations Online.

Economic development activity in Scotland

Evaluations Online is a public portal providing access to a collection of evaluation and economic development research reports commissioned by Scottish Enterprise. Scottish Enterprise is Scotland’s main economic development agency and a non-departmental public body of the Scottish Government.

Idox won the contract to deliver Evaluations Online in 2007. The team developed a site which utilises a publishing platform designed specifically to deal with research material. Users can easily navigate to and assess the relevance of material thanks to specially-written abstracts and structured search functions based on a bespoke classification and record structure.

The site now contains over 500 evaluation and research reports commissioned by Scottish Enterprise, dealing with different aspects of economic development activity such as business support, investment, sector growth and improving skills. All of the reports are publicly accessible and free to access.

In 2011, the team won a further contract to refresh and improve the site, focusing on how the site could be refined to better meet the needs of key user groups including economic development policy-makers and practitioners across Scotland. In the last quarter of 2016, the reports hosted on the site were accessed over 30,000 times.

The importance of evaluation

One of the key reports hosted on Evaluation Online is the annual review of the risk capital market in Scotland. Scottish Enterprise commissions the report annually in order to consider the scale of new investment flows. The findings are also used to inform the nature of Scottish Enterprise interventions in the Scottish early stage risk capital market, such as the Scottish Co-Investment Fund and Scottish Venture Fund.

Scottish Enterprise commissions evaluations of projects and programmes each year in order to identify their contribution towards economic growth in Scotland, and particularly in terms of their impact on gross value added (GVA) and employment. As the findings of the evaluations inform decisions about public spending, it’s important that all of the appraisal and evaluation work is of a high technical standard.

We’ve highlighted the importance of evidence and evaluation on the blog several times before. It’s worth repeating that repositories of evidence can help bring about better policy in a number of ways:

  • improve accountability by making it easier for people to scrutinise the activities and spending of public sector organisations – this helps organisations meet Freedom of Information responsibilities;
  • improve the visibility and therefore the impact of evidence;
  • help identify gaps in evidence by making it easier to compare research findings; and
  • increase our understanding of what works (‘good practice’), not only in the activities covered, but also in evaluation and research methods.

We’re proud to support Scottish Enterprise in the dissemination of their evaluation and research output, through a portal which they believe increases the return on these activities.

You can find out more about the projects The Knowledge Exchange team has been involved in, and the consultancy services we offer, here.

 

From data to intelligence and improvement – what cutting edge councils are doing in the UK

Group of workers having a meeting

By Steven McGinty

Data has the potential to revolutionise the delivery of local services. Just like the private sector – where organisations such as Amazon and Facebook have leveraged user data – local councils have the opportunity to reap significant benefits from analysing their vast silos of data. Improving efficiencies, increasing levels of transparency, and providing services which better meet people’s needs, are just some of the potential benefits.

Although many councils are still at the early stages of utilising their data, some are innovating and introducing successful data initiatives.

Wise Councils

In November 2016, the charity NESTA published a report highlighting the most ‘pioneering’ uses of data in local government. The report emphasised that most local services would benefit from data analysis and that a ‘problem-oriented’ approach is required to generate insights that have an impact on services. The case studies included:

Kent County Council

Kent County Council (KCC), alongside Kent’s seven Clinical Commissioning Groups (CCGs), have created the Kent Integrated Dataset (KID) – one of the largest health and care databases in the UK, covering the records of 1.5 million people. The core requirement of the dataset was to link data from multiple sources to a particular individual, i.e. that information held about a person in hospital, should also be linked to records held by other public bodies such as GPs or the police.

This integrated dataset has enabled the council to run sophisticated data analysis, helping them to evaluate the effectiveness of services and to inform decisions on where to locate services. For example, Kent’s Public Health team investigated the impact of home safety visits by Kent Fire and Rescue Service (KFRS) on attendances at accident and emergency services (A&E). The data suggested that home safety visits did not have a significant impact on an individual’s attendance at A&E.

Leeds City Council

Leeds City Council have focused their efforts on supporting open innovation – the concept that good ideas may come from outside an organisation. This involved the initiatives:

  • Data Mill North (DMN) – this collaborative project between the city council and private sector is the city’s open data portal (growing from 50 datasets in 2014 to over 300 data sets, in over 40 different organisations). To encourage a culture change, Leeds City Council introduced an ‘open by default’ policy in November 2015, requiring all employees to make data available to the public. A number of products have been developed from data published on DMN, including StreetWise.life, which provides local information online, such as hospital locations, road accidents, and incidents of crime.
  • Innovation Labs – the city has introduced a series of events that bring together local developers and ‘civic enthusiasts’ to tackle public policy problems. Leeds City Council has also provided funding, allowing some ideas to be developed into prototypes. For example, the waste innovation lab created the app, Leeds Bins, which informs residents which days their bins should be put out for collection.

Newcastle City Council

Newcastle City Council have taken a data-led approach to the redesign of their children’s services. The Family Insights Programme (FIP) used data analysis to better understand the demand and expenditure patterns in the children’s social care system. Its aim was to use this insight to support the redesign of services and to reduce the city’s high re-referrals and the number of children becoming looked-after.

The FIP uses data in three different ways:

  • Grouping families by need – The council have undertaken cluster analysis to identify common grouping of concerning behaviours, such as a child’s challenging behaviour or risk of physical abuse. When a child is referred to long term social work, senior social workers analyse the concerning behaviours of the case, and then make a referral to a specialist social work unit. Since introducing this data-led approach, social work units have been organised based on needs and concerning behaviours. This has resulted in social workers becoming specialists in supporting particular needs and behaviours, providing greater expertise in the management of cases.
  • Embedding data analysts – Each social work unit has an embedded data analyst, who works alongside social workers. Their role is to test what works, as well as providing insights into common patterns for families.
  • Enabling intelligent case management – Social workers have access to ChildSat, a tool which social workers use to help manage their cases. It also has the capability to monitor the performance of individual social work units.

Investing in data

Tom Symons, principal researcher in government innovation at Nesta, has suggested that councils need support from central government if they are to accelerate their use of data. He’s suggested that £4 million – just £1% of the Government Digital Service (GDS) budget – is spent on pilot schemes to embed data specialists into councils.

Mr Symons has also proposed that all combined authorities should develop Offices of Data Analytics, to support data analysis across counties. Over the past few months, Nesta has been working on this idea with the Greater London Authority, and a number of London boroughs, to tackle the problem of unlicensed HMOs (Houses in Multiple Occupation). Early insights highlight that data analytics could be used to show that new services would provide value for money.

Final thoughts  

After successive years of cuts, there has never been a greater need for adopting a data-led approach. Although there are undoubtedly challenges in using council data – including changing a culture where data sharing is not the norm, and data protection – the above examples highlight that overcoming these challenges is achievable, and that data analysis can be used to bring benefits to local councils.


Follow us on Twitter to see what developments in public and social policy are interesting our research team. If you found this article interesting, you may also like to read our other digital articles. 

Research Online: Scotland’s labour market hub

ro-pic

by Stacey Dingwall

As well as the Idox Information Service, the Knowledge Exchange Team manages two other research portals – Research Online and Evaluations Online.

This blog focuses on Research Online, which we developed over 13 years ago and have worked with Skills Development Scotland to maintain and update ever since.

Scottish labour market intelligence

Research Online is Scotland’s labour market hub. The portal provides an authoritative source of labour market research and analysis relevant to Scotland and supports evidence-based policy making in the Scottish labour market.

Before Research Online was created, research suggested that although useful labour market research and analysis was undertaken within Scotland by a large range of organisations, there was no single dissemination source.

Therefore, a requirement existed for a portal that clearly identified current labour market intelligence (LMI), provided a common understanding of current gaps and provision in areas including labour supply and skills, and focused action to ensure LMI met Scottish user needs.

Research Online was conceived to improve access to this wealth of intelligence.

The most comprehensive collection of labour market intelligence

The portal now contains thousands of documents on a range of labour market topics including:

  • Employment;
  • Skills and training;
  • Unemployment;
  • Entrepreneurship;
  • Vocational education and training;
  • Workforce development; and
  • Equal opportunities.

The material available on the portal includes research, policy, analysis, discussion and sectoral and geographic profiles. Our team sources the latest research and policy documents from a wide range of sources, including academic journals, government departments and agencies, labour market research centres and material sent in directly by key organisations in Scotland and the wider UK. The available material includes grey literature, government policy and up-to-date academic research.

Research Online also incorporates a current awareness service that alerts registered users to new material on a fortnightly basis. It also has integrated reading list functionality.

Free to access

Research Online can be accessed by anyone, free of charge. You can browse the material here without registering, as well as create reading lists to be accessed at a later date or shared with colleagues.

If you would like to sign-up for a range of current awareness alerts that keep you up to date on a variety of labour market topics, covering both Scotland and the wider UK, you can do so here.

Our shared vision is for Research Online to be recognised as a key dissemination mechanism by Scotland’s producers of labour market intelligence and to be at the centre of a community of practice for labour market researchers, practitioners and policy-makers.

You can find out more about the projects The Knowledge Exchange team has been involved in, and the consultancy services we offer, here.

 

The Use and Application of Knowledge: A practitioner’s Guide

This presentation was given by our director, Rebecca Riley, at our recent event ‘Investing in Knowledge – improving services and decision-making‘. It explores different decision making models and how services like The Knowledge Exchange inform different stages of the decision making process. Stay tuned for the rest of the presentations from the day.