Calibration Curve Plotter

Overview

This analytical tool compares predicted probabilities against historical settlement rates to expose systematic bias. It reveals if a 70% probability bet actually wins 70% of the time or if the market is overconfident.

What It Does

The plotter aggregates resolved market questions into probability buckets such as 60-65% or 90-95%. It calculates the actual win rate for each bucket and plots this against a perfect diagonal line. Deviations from this line indicate where the market consistently misprices risk.

Why It Matters

Markets often exhibit structural inefficiencies like the favorite-longshot bias where underdogs are overpriced and favorites are underpriced. Identifying these zones allows traders to bet against the crowd's psychological flaws rather than just the event fundamentals.

How It Works

The system pulls settlement data for thousands of closed markets and groups them by their closing probability. It computes the percentage of 'Yes' outcomes for each group. This data generates a curve that visualizes the 'Calibration Error' for any given price point.

Methodology

We utilize recursive binning with a minimum sample size of 50 markets per bucket to reduce noise. The core metric is the Brier Score decomposition which separates reliability from resolution. We apply Isotonic Regression to smooth the curve and provide a clear signal for the current market price.

Edge & Advantage

This provides a purely statistical edge that functions independently of news or fundamental analysis. It highlights mathematically profitable entry points based solely on market psychology.

Key Indicators

• Bucket Accuracy Delta

  high

  Difference between implied probability and historical win rate for this price tier

• Overconfidence Bias Score

  medium

  Metric indicating if the market is too certain about extreme outcomes

• Perfect Calibration Deviation

  high

  Distance from the ideal 45-degree line representing perfect pricing

Data Sources

• Platform Settlement History

  Aggregated logs of all resolved markets and their closing prices

• Cross-Platform Odds Archive

  Historical pricing data from competing prediction exchanges for comparative baselines

Example Questions This Pillar Answers

• → Will the ruling party retain their majority in the upcoming election?
• → Will Bitcoin exceed $100k before the end of Q4?
• → Will the specified hurricane make landfall as a Category 3 storm?

Tags