Weather Data Collector

Total Scan Records

Data Files

Scan Interval

Next Scan

Last Scan (this boot)

Collection Cycles

	Cycle ID	Timestamp	Markets	Cities

No scan cycles for this date. Trigger a scan or wait for the scheduler.

Data Files

	Date	Records

No data files yet.

From: To: City:

Records Loaded

Cities

Avg Ensemble Members

METAR Coverage

City	Range	Event Date	Days	YES Price	Ens. Prob	NO Edge	Ens. Mean	Ens. Std	METAR Max	YES Depth	Spread	Scan Time

No scan data. Select a date and click Load.

Level: Export CSV Auto-scroll

Collector Settings

Changes are saved to disk and persist across restarts.

Weather Data Collector DATA ONLY

Branch: bot-data-collector — forked from std-adaptive-inflation-3

Purpose

Pure data collection bot — no trading. Scans Polymarket weather markets, Open-Meteo ensemble forecasts, and METAR airport observations every 1–2 hours. Produces one JSONL record per market per scan cycle for offline analysis of edges, arbitrage opportunities, and market dynamics.

Data collected per scan (~75 fields)

Category	Fields
Market	condition_id, tokens, city, temp range, event_date, neg_risk
YES Order Book	best_ask, best_bid, spread, depth_ask, depth_bid, ask_levels, bid_levels
NO Order Book	Same full snapshot (both sides)
Event-Level	all_bracket_yes_prices, sum_yes_prices, overround, num_buckets
Point Forecast	high_f, low_f
Ensemble	mean, std, spread, p10–p90, models, raw member values + weights
Bucket Prob	raw, inflated (std-adaptive), inflation_factor, yes_edge, no_edge
METAR	observed max/min, latest temp, dewpoint max, heating rate, full hourly profile
Wind	speed (kt), direction (mean + spread)
Station	ICAO, lat, lon, country

Storage format

JSONL files: data/scans/scans_YYYY-MM-DD.jsonl — one JSON line per market per scan. Load into pandas: pd.read_json("scans_2026-04-05.jsonl", lines=True). CSV export available via dashboard or API.

API endpoints

GET /api/status	Scheduler status + scan stats
POST /api/trigger-cycle	Manually trigger a collection cycle
GET /api/autocycle	auto_cycle_enabled, last_cycle_at, next_cycle_at
POST /api/autocycle {"enabled": bool}	Dashboard toggle, persisted to the volume
GET /api/maker-snapshot	maker_snapshot_enabled, last_maker_snapshot_at, next_maker_snapshot_at
POST /api/maker-snapshot {"enabled": bool}	Maker snapshot toggle, persisted to the volume; writes data/maker/books_.jsonl and trades_.jsonl
POST /api/trigger-maker-snapshot	Run one maker snapshot now
GET /api/scans?scan_date=&city=	Scan records as JSON
GET /api/scans/csv?scan_date=&city=	CSV download
GET /api/scans/files	List all data files
GET /api/scans/summary	Cycles grouped by city

Data sources

Polymarket Gamma API — market titles, prices, token IDs
Polymarket CLOB — full order book (YES + NO sides)
Open-Meteo Ensemble API — multi-model ensemble (ECMWF, GFS, GEM, ICON, etc.)
Open-Meteo Forecast API — deterministic point forecast
aviationweather.gov METAR API — hourly airport observations