Consensus Compass
The Delphinity Consensus Compass is an automated Excel workbook designed to simplify the analysis and reporting of two-round Delphi studies. Enter participant ratings, define your study’s consensus rules, and generate clear item-level decisions, panel summaries, change metrics, dashboards, and publication-ready results.
Unlike calculators that impose a universal definition of consensus, the Consensus Compass requires you to specify your decision rules before interpreting the data. This supports a more transparent and methodologically defensible Delphi process.
What the calculator does
Calculates median and interquartile range
Measures percentage agreement for inclusion and exclusion
Applies your predefined consensus thresholds
Classifies items as Include, Re-rate, or Exclude
Matches participants across rounds using stable rater IDs
Measures individual rating changes between rounds
Calculates mean signed and absolute change
Identifies unchanged, increased, and decreased ratings
Tracks participant retention and attrition
Produces an automated visual dashboard
Generates a publication-ready reporting table
Understand how individual judgments change
Consensus is not only about the final distribution of scores. The Consensus Compass shows how individual panelists change their ratings between rounds—even when participants appear in a different row order.
Its matched-rater analysis reports:
Number of comparable item ratings
Average direction of change
Mean absolute rating change
Percentage of unchanged ratings
Number of increases and decreases
Maximum observed rating shift
Item-by-item changes for every matched participant
This provides a more complete view of convergence, stability, and movement within the panel.
Designed for real Delphi workflows
The workbook includes separate areas for:
Consensus-rule specification
Round 1 and Round 2 data entry
Automated item analysis
Participant-level change analysis
Retention and attrition monitoring
Dashboard review
Publication-ready reporting
Instructions and methodological safeguards
The calculator accommodates up to 20 items and 100 participants per round. Synthetic demonstration data are included so you can explore the tool before entering your own study data.
Ideal for
Delphi study investigators
Graduate students and trainees
Research coordinators
Consensus-methods researchers
Academic and clinical research teams
Implementation and health-policy researchers
Consultants analyzing structured expert judgment
Built for clarity and credibility
The Consensus Compass uses Delphinity’s signature design system and Playfair typography to create a polished, intuitive research experience. Input fields, calculated outputs, methodological guidance, and decision statuses are visually differentiated for efficient use.
What you receive
One downloadable Microsoft Excel workbook containing:
The complete Consensus Compass calculator
Automated formulas and decision logic
A branded results dashboard
Matched-rater change analysis
A publication-ready reporting table
Instructions and methodological guidance
Synthetic practice data
Important methodological note
The Consensus Compass supports analysis; it does not determine which definition of consensus is appropriate for your study. Investigators remain responsible for selecting, justifying, and preferably preregistering consensus thresholds that align with their research question, rating scale, and protocol.
Define consensus before you measure it.
The Delphinity Consensus Compass is an automated Excel workbook designed to simplify the analysis and reporting of two-round Delphi studies. Enter participant ratings, define your study’s consensus rules, and generate clear item-level decisions, panel summaries, change metrics, dashboards, and publication-ready results.
Unlike calculators that impose a universal definition of consensus, the Consensus Compass requires you to specify your decision rules before interpreting the data. This supports a more transparent and methodologically defensible Delphi process.
What the calculator does
Calculates median and interquartile range
Measures percentage agreement for inclusion and exclusion
Applies your predefined consensus thresholds
Classifies items as Include, Re-rate, or Exclude
Matches participants across rounds using stable rater IDs
Measures individual rating changes between rounds
Calculates mean signed and absolute change
Identifies unchanged, increased, and decreased ratings
Tracks participant retention and attrition
Produces an automated visual dashboard
Generates a publication-ready reporting table
Understand how individual judgments change
Consensus is not only about the final distribution of scores. The Consensus Compass shows how individual panelists change their ratings between rounds—even when participants appear in a different row order.
Its matched-rater analysis reports:
Number of comparable item ratings
Average direction of change
Mean absolute rating change
Percentage of unchanged ratings
Number of increases and decreases
Maximum observed rating shift
Item-by-item changes for every matched participant
This provides a more complete view of convergence, stability, and movement within the panel.
Designed for real Delphi workflows
The workbook includes separate areas for:
Consensus-rule specification
Round 1 and Round 2 data entry
Automated item analysis
Participant-level change analysis
Retention and attrition monitoring
Dashboard review
Publication-ready reporting
Instructions and methodological safeguards
The calculator accommodates up to 20 items and 100 participants per round. Synthetic demonstration data are included so you can explore the tool before entering your own study data.
Ideal for
Delphi study investigators
Graduate students and trainees
Research coordinators
Consensus-methods researchers
Academic and clinical research teams
Implementation and health-policy researchers
Consultants analyzing structured expert judgment
Built for clarity and credibility
The Consensus Compass uses Delphinity’s signature design system and Playfair typography to create a polished, intuitive research experience. Input fields, calculated outputs, methodological guidance, and decision statuses are visually differentiated for efficient use.
What you receive
One downloadable Microsoft Excel workbook containing:
The complete Consensus Compass calculator
Automated formulas and decision logic
A branded results dashboard
Matched-rater change analysis
A publication-ready reporting table
Instructions and methodological guidance
Synthetic practice data
Important methodological note
The Consensus Compass supports analysis; it does not determine which definition of consensus is appropriate for your study. Investigators remain responsible for selecting, justifying, and preferably preregistering consensus thresholds that align with their research question, rating scale, and protocol.
Define consensus before you measure it.

