Operations

Jobs and Data Pipeline

Run the automated refresh flow, backfill imports, and watch the latest collectibles pipeline activity from one dark control room.

View Rankings
Automated Pipeline
The automation flow seeds candidate cards from the population source, reprioritizes sports cards using player sources when available, refreshes sold comps and active raw listings from eBay, then recalculates rankings. Pokemon runs also refresh the TCG catalog and Pokemon candidate seed before the rest of the pipeline. If a Pokemon prep stage fails during an ALL run, the pipeline can continue and the failure will show up in the run summary plus the JSONL/CSV reports.
PopulationNot configured — eBay discovery used as fallback
NFL PlayersConfigured
MLB PlayersConfigured
NBA PlayersConfigured
eBayConfigured
Sold CompsRequires Marketplace Insights approval; check scopes from Docs.
SchedulerAuto-refresh every 24h
Grading TierEconomy (set GRADING_TIER in .env)
Pokemon CatalogLoaded
Pokemon PopulationOptional — set POKEMON_POPULATION_SOURCE_FILE or _URL
Used by pipeline, comps, listings, provider backfills, and metrics.
Max 200 (eBay limit per page)
PSA
BGS/Beckett
SGC
Manual Imports

Use these tools for CSV backfills or to patch source coverage gaps. The automated pipeline remains the primary path.

Sales template | Population template
Candidate Seed

Expand the candidate universe outside the automated feeds with a curated seed source, one-off manual adds, or candidate CSV uploads.

Configured FeedOptional / missing config
Pokemon FeedConfigured
Player EnrichmentSoft validation enabled
Download Candidate CSV
Candidate template
Manual eBay Backfill / Discovery

Use this for manual discovery or backfills only. It does not run as part of the full pipeline.

Recent Job Runs
ID Job Status Scope Processed Inserted Skipped Rejected Started Reports
1105 refresh_sportscardspro success ALL 105 18 3 84 2026-07-17 09:34 Summary JSONL CSV
1104 recalc_metrics success ALL 8917 8917 0 0 2026-07-17 09:31 Summary JSONL CSV
1103 refresh_active_raw success ALL 1872 543 930 399 2026-07-17 09:29 Summary JSONL CSV
1102 refresh_sold_comps success ALL 0 0 1 0 2026-07-17 09:29 Summary JSONL CSV
1101 refresh_player_pool success ALL 827 827 0 1 2026-07-17 09:29 Summary JSONL CSV
1100 discover_candidates_from_ebay success ALL 1810 8 1802 0 2026-07-17 09:28 Summary JSONL CSV
1099 refresh_candidate_seed success POKEMON 7911 95 7816 0 2026-07-17 09:28 Summary JSONL CSV
1098 refresh_tcg_catalog success POKEMON 60 60 0 0 2026-07-17 09:27 Summary JSONL CSV
1097 refresh_pipeline success ALL 9 8 1 0 2026-07-17 09:27 Summary JSONL CSV
1096 refresh_sportscardspro success ALL 3 1 2 0 2026-07-16 09:35 Summary JSONL CSV
1095 recalc_metrics success ALL 8812 8812 0 0 2026-07-16 09:32 Summary JSONL CSV
1094 refresh_active_raw success ALL 3464 517 1748 1199 2026-07-16 09:29 Summary JSONL CSV
1093 refresh_sold_comps success ALL 0 0 1 0 2026-07-16 09:29 Summary JSONL CSV
1092 refresh_player_pool success ALL 819 819 0 1 2026-07-16 09:29 Summary JSONL CSV
1091 discover_candidates_from_ebay success ALL 1814 1 1813 0 2026-07-16 09:28 Summary JSONL CSV
1090 refresh_candidate_seed success POKEMON 7816 0 7816 0 2026-07-16 09:28 Summary JSONL CSV
1089 refresh_tcg_catalog success POKEMON 59 59 0 0 2026-07-16 09:27 Summary JSONL CSV
1088 refresh_pipeline success ALL 9 8 1 0 2026-07-16 09:27 Summary JSONL CSV
1087 refresh_sportscardspro success ALL 3 2 1 0 2026-07-15 09:34 Summary JSONL CSV
1086 recalc_metrics success ALL 8809 8809 0 0 2026-07-15 09:31 Summary JSONL CSV