Evaluation Analysis Tools

To help you analyse the data we have provided two excel based tools. The tool will enable you to translate the raw data and measure against each of the 15 client outcomes. We have provided one tool for use with online survey methodology and another for use with all other methodologies.

Analysing manually completed (paper) questionnaires

For those using self completed returns from clients, we have provided an excel based tool to help you analyse the findings. As there is no automation, there will firstly need to a be manual process which identifies the numbers of people answering each element of every question. This will require counting (e.g. via tally charts) to ensure the right amount of responses are captured.

The tool is designed so that you only need to complete cells that are coloured grey – all other cells will automatically update and have been locked to ensure the underlying formulae do not get distorted.

There are two key pieces of information required for each question, to be inputted into the ‘Input Sheet’:

The first is the total number of people answering the question. This forms your base size from which all percentages will be calculated. This should be placed in the top grey box for each question adjacent to “Total number of clients answering question”. For illustration, there is a default setting of 100 responses which needs to be amended according to your final sample size. Be aware that the respondent number may change between each question depending on the number of people missing the question out or skipping questions.

The second is the total number of responses for each element of the question. This needs to be inputted into the adjacent grey boxes.

Once all of this information is in place, the spreadsheet will automatically update the percentages on the right hand side of the sheet. As a check, for questions that are ‘tick one box only’, all percentages should add up to 100%. For questions that are ‘Tick all that apply’, the total can add up to more than 100%.

Context vs Outcomes - The colour coding indicates that GREEN questions are designated as ones that influence a key outcome. These answers will automatically populate the final outcomes sheet and will act as your KPIs. The survey also contains a number of context questions in ORANGE. Whilst these do not drive the outcomes directly, they are there to ensure a depth of knowledge from your clients and to add insight to the outcome questions

Once all the data has been inputted into the ‘INPUT SHEET’, the positive responses to the key outcome questions automatically transfer to the KEY OUTCOMES sheet. This will provide detail for each of the 15 outcomes, some of which have 2 or more indicators as a proxy for that outcome.

In the column titled ‘Input desired target’, there is an opportunity to enter your minimum target needed for each outcome. This is up for you to decide and can be the same for all outcomes, or vary for each. The default setting is 75%, which means that any answers of 75% or above will be in green (i.e. it has achieved the target), and anything 74% or less will be red (i.e. it has under achieved). To change the target, simply type in the new percentage in the column and the colours will automatically adjust.

An additional sheet has been provided should you wish to use this document for capturing the verbatim comments you receive with the survey responses.

Download the paper-based evaluation tool – use this tool if you have used any other methodology and you only have raw numerical data for each question (this will be in the case of paper based or telephone survey)

Analysing online completed questionnaires

For those using online surveys, we have provided an excel based tool to help you analyse the findings.

The tool is designed so that you only need to complete cells that are coloured grey – all other cells will automatically update and have been locked to ensure the underlying formulae do not get distorted.

There is one key piece of information required for each question, to be inputted into the ‘Input Sheet’. The percentages from the online results output will need to be entered into the spreadsheet next to the relevant question numbers.

Context vs Outcomes - The colour coding indicates that GREEN questions are designated as ones that influence a key outcome. These answers will automatically populate the final outcomes sheet and will act your KPIs. The survey also contains a number of context questions in ORANGE. Whilst these do not drive the outcomes directly, they are there to ensure a depth of knowledge from your clients and to add insight to the outcome questions.

Once all the data has been inputted into the ‘INPUT SHEET’, the positive responses to the key outcome questions automatically transfer to the KEY OUTCOMES sheet. This will provide detail for each of the 15 outcomes, some of which have 2 or more indicators as a proxy for that outcome.

In the column titled ‘Input desired target’, there is an opportunity to enter your minimum target needed for each outcome. This is up for you to decide and can be the same for all outcomes, or vary for each. The default setting is 75%, which means that any answers of 75% or above will be in green (i.e. it has achieved the target), and anything 74% or less will be red (i.e. it has under achieved). To change the target, simply type in the new percentage in the column and the colours will automatically adjust.

An additional sheet has been provided should you wish to use this document for capturing the verbatim comments you receive with the survey responses.

Download the online evaluation tool – use this tool if you already have automated percentages (you would have this if you have used an online survey)

If you are using SmartSurvey to collect survey data, click hereto see how to transfer data into the online evaluation tool.

Development| Introduction| Methodology| Time & Sampling | Feedback