Skip to main content

Comparison Report

Overview — Do the Survey and the Interviews Agree?

The Comparison Report sets survey results against interview results side by side. That disagreement is often the most valuable finding in an assessment.

Open it from Reports → Comparison Report. Needs Reports read access.

image.png

What the Report Contains

Overall Comparison

An Overall Comparison chart per ISF framework, with a Score Details table beneath it.

PRO TIP  Start here. If the two sources broadly agree, the rest of the report confirms detail; if they diverge, you have found your headline.

Demographic comparisons

Chart

Compares by

Location Comparison

Site or location.

Employee Type Comparison

Employment type.

Level Comparison

Organizational level.

Department Comparison

Department.

 

HEADS UP  These four depend on both sides carrying demographic data. A blank chart usually means one side is missing that data, not that the groups scored identically.

 

PRO TIP  The Level comparison is frequently the most revealing. Where supervisors and operators rate the same subject differently, you are looking at a communication problem rather than a technical one.

Themes comparison

A themes-based comparison, with charts and detail tables.

GOOD TO KNOW  This section depends on your theme tagging on both survey comments and interview answers.

Positive and Negative Attributes

Two sections listing the attributes scoring best and worst, each with its own table. Entries can be marked Interview Only where a finding came from interviews with no survey equivalent.

PRO TIP  The Negative Attributes table is the shortest route to your recommendations — effectively a ranked list of what needs attention, already classified against the framework. Take an entry from here, create the recommendation, and then use Search for Evidence to attach what supports it.

 

GOOD TO KNOW  Interview Only markers show subjects your interviews surfaced that the survey never asked about — worth considering when you design the next assessment's survey.

Exporting

The Positive Attributes and Negative Attributes sections each have a Download Excel button.

HEADS UP  Only those two sections export. The charts — overall and demographic — are on-screen only, and there is no PDF export on this report. To use the charts in a report pack you will need to capture them from the screen.

 

PRO TIP  Export both attribute tables and screenshot the overall comparison chart. Between them you have the assessment's headline and its supporting detail.

Reading a Divergence

Pattern

Often means

Survey positive, interviews negative

People will say more in conversation than on a form — or the survey question was read differently than intended.

Survey negative, interviews positive

Interviewees may be guarded face to face, or your interview sample is not representative.

Wide gap in one department only

A local issue the survey's aggregate hides.

Wide gap at one organizational level

A difference in what each level sees, or in what they feel able to say.

Interview Only findings

The survey did not ask about it. A gap in survey design, not in the data.

 

HEADS UP  Check your sample sizes before concluding anything. A handful of interviews against several hundred survey responses will diverge on statistical noise alone.

 

PRO TIP  Where the two sources disagree and both are well-sampled, say so explicitly in your report rather than picking whichever supports your conclusion.

What Feeds This Report

Side

Needs

Survey

Responses collected, demographic questions asked and answered, comments rated and themed.

Interviews

Responses recorded with ratings, themes, and the four demographic fields filled in.

 

HEADS UP  This is the report most sensitive to incomplete data entry. Interviews recorded without demographics, or survey comments left uncoded, produce charts that are blank or misleading rather than obviously broken.

 

PRO TIP  Run this report before you finish collecting. It is the quickest way to discover that your interviews are missing demographics — while there is still time to go back and fill them in.

Common Problems

What you see

What it means

Reports group missing from the activity

You have no Reports read access.

Charts empty or missing

One side lacks the data — usually interview demographics or survey demographic questions.

A demographic comparison is blank

That demographic was not captured on one or both sides.

Themes comparison thin

Comments and interview answers were not themed consistently.

Many Interview Only entries

The survey did not cover subjects the interviews raised. Note it for next time.

Only two Download Excel buttons

Correct — the charts do not export.

No PDF export

Correct — this report has none.

A divergence that seems implausible

Check sample sizes on both sides before treating it as real.

No interview data at all

No interview responses have been submitted.