Operations

Jobs and Data Pipeline

Run the automated refresh flow, backfill imports, and watch the latest collectibles pipeline activity from one dark control room.

View Rankings
Automated Pipeline
The automation flow seeds candidate cards from the population source, reprioritizes sports cards using player sources when available, refreshes sold comps and active raw listings from eBay, then recalculates rankings. Pokemon runs also refresh the TCG catalog and Pokemon candidate seed before the rest of the pipeline. If a Pokemon prep stage fails during an ALL run, the pipeline can continue and the failure will show up in the run summary plus the JSONL/CSV reports.
PopulationNot configured — eBay discovery used as fallback
NFL PlayersConfigured
MLB PlayersConfigured
NBA PlayersConfigured
eBayConfigured
Sold CompsRequires Marketplace Insights approval; check scopes from Docs.
SchedulerAuto-refresh every 24h
Grading TierEconomy (set GRADING_TIER in .env)
Pokemon CatalogLoaded
Pokemon PopulationOptional — set POKEMON_POPULATION_SOURCE_FILE or _URL
Used by pipeline, comps, listings, provider backfills, and metrics.
Max 200 (eBay limit per page)
PSA
BGS/Beckett
SGC
Manual Imports

Use these tools for CSV backfills or to patch source coverage gaps. The automated pipeline remains the primary path.

Sales template | Population template
Candidate Seed

Expand the candidate universe outside the automated feeds with a curated seed source, one-off manual adds, or candidate CSV uploads.

Configured FeedOptional / missing config
Pokemon FeedConfigured
Player EnrichmentSoft validation enabled
Download Candidate CSV
Candidate template
Manual eBay Backfill / Discovery

Use this for manual discovery or backfills only. It does not run as part of the full pipeline.

Recent Job Runs
ID Job Status Scope Processed Inserted Skipped Rejected Started Reports
2049 refresh_sportscardspro success ALL 1437 45 112 1280 2026-11-14 10:53 Summary JSONL CSV
2048 recalc_metrics success ALL 9498 9498 0 0 2026-11-14 10:49 Summary JSONL CSV
2047 refresh_active_raw success ALL 61 55 0 6 2026-11-14 10:48 Summary JSONL CSV
2046 refresh_sold_comps success ALL 0 0 1 0 2026-11-14 10:48 Summary JSONL CSV
2045 refresh_player_pool success ALL 1103 1103 0 1 2026-11-14 10:48 Summary JSONL CSV
2044 discover_candidates_from_ebay success ALL 1790 2 1788 0 2026-11-14 10:48 Summary JSONL CSV
2043 refresh_candidate_seed success POKEMON 8210 0 8210 0 2026-11-14 10:47 Summary JSONL CSV
2042 refresh_tcg_catalog success POKEMON 63 63 0 0 2026-11-14 10:46 Summary JSONL CSV
2041 refresh_pipeline success ALL 9 8 1 0 2026-11-14 10:46 Summary JSONL CSV
2040 refresh_sportscardspro success ALL 1647 39 175 1433 2026-11-13 10:53 Summary JSONL CSV
2039 recalc_metrics success ALL 9494 9494 0 0 2026-11-13 10:49 Summary JSONL CSV
2038 refresh_active_raw success ALL 109 72 0 37 2026-11-13 10:48 Summary JSONL CSV
2037 refresh_sold_comps success ALL 0 0 1 0 2026-11-13 10:48 Summary JSONL CSV
2036 refresh_player_pool success ALL 1101 1101 0 1 2026-11-13 10:48 Summary JSONL CSV
2035 discover_candidates_from_ebay success ALL 1792 1 1791 0 2026-11-13 10:47 Summary JSONL CSV
2034 refresh_candidate_seed success POKEMON 8210 0 8210 0 2026-11-13 10:46 Summary JSONL CSV
2033 refresh_tcg_catalog success POKEMON 63 63 0 0 2026-11-13 10:46 Summary JSONL CSV
2032 refresh_pipeline success ALL 9 8 1 0 2026-11-13 10:46 Summary JSONL CSV
2031 refresh_sportscardspro success ALL 1893 34 213 1646 2026-11-12 10:53 Summary JSONL CSV
2030 recalc_metrics success ALL 9493 9493 0 0 2026-11-12 10:49 Summary JSONL CSV