Operations

Jobs and Data Pipeline

Run the automated refresh flow, backfill imports, and watch the latest collectibles pipeline activity from one dark control room.

View Rankings
Automated Pipeline
The automation flow seeds candidate cards from the population source, reprioritizes sports cards using player sources when available, refreshes sold comps and active raw listings from eBay, then recalculates rankings. Pokemon runs also refresh the TCG catalog and Pokemon candidate seed before the rest of the pipeline. If a Pokemon prep stage fails during an ALL run, the pipeline can continue and the failure will show up in the run summary plus the JSONL/CSV reports.
PopulationNot configured — eBay discovery used as fallback
NFL PlayersConfigured
MLB PlayersConfigured
NBA PlayersConfigured
eBayConfigured
Sold CompsRequires Marketplace Insights approval; check scopes from Docs.
SchedulerAuto-refresh every 24h
Grading TierEconomy (set GRADING_TIER in .env)
Pokemon CatalogLoaded
Pokemon PopulationOptional — set POKEMON_POPULATION_SOURCE_FILE or _URL
Used by pipeline, comps, listings, provider backfills, and metrics.
Max 200 (eBay limit per page)
PSA
BGS/Beckett
SGC
Manual Imports

Use these tools for CSV backfills or to patch source coverage gaps. The automated pipeline remains the primary path.

Sales template | Population template
Candidate Seed

Expand the candidate universe outside the automated feeds with a curated seed source, one-off manual adds, or candidate CSV uploads.

Configured FeedOptional / missing config
Pokemon FeedConfigured
Player EnrichmentSoft validation enabled
Download Candidate CSV
Candidate template
Manual eBay Backfill / Discovery

Use this for manual discovery or backfills only. It does not run as part of the full pipeline.

Recent Job Runs
ID Job Status Scope Processed Inserted Skipped Rejected Started Reports
649 refresh_sportscardspro success ALL 159 17 6 136 2026-05-18 09:30 Summary JSONL CSV
648 recalc_metrics success ALL 8552 8552 0 0 2026-05-18 09:28 Summary JSONL CSV
647 refresh_active_raw success ALL 679 393 1 285 2026-05-18 09:26 Summary JSONL CSV
646 refresh_sold_comps success ALL 0 0 1 0 2026-05-18 09:26 Summary JSONL CSV
645 refresh_player_pool success ALL 660 660 0 1 2026-05-18 09:26 Summary JSONL CSV
644 discover_candidates_from_ebay success ALL 1918 2 1916 0 2026-05-18 09:25 Summary JSONL CSV
643 refresh_candidate_seed success POKEMON 7719 0 7719 0 2026-05-18 09:24 Summary JSONL CSV
642 refresh_tcg_catalog success POKEMON 58 58 0 0 2026-05-18 09:24 Summary JSONL CSV
641 refresh_pipeline success ALL 9 8 1 0 2026-05-18 09:24 Summary JSONL CSV
640 refresh_sportscardspro success ALL 182 21 5 156 2026-05-17 01:53 Summary JSONL CSV
639 recalc_metrics success ALL 8549 8549 0 0 2026-05-17 01:50 Summary JSONL CSV
638 refresh_active_raw success ALL 972 706 0 266 2026-05-17 01:48 Summary JSONL CSV
637 refresh_sold_comps success ALL 0 0 1 0 2026-05-17 01:48 Summary JSONL CSV
636 refresh_player_pool success ALL 658 658 0 1 2026-05-17 01:48 Summary JSONL CSV
635 discover_candidates_from_ebay success ALL 1922 1 1921 0 2026-05-17 01:47 Summary JSONL CSV
634 refresh_candidate_seed success POKEMON 7719 0 7719 0 2026-05-17 01:46 Summary JSONL CSV
633 refresh_tcg_catalog success POKEMON 58 58 0 0 2026-05-17 01:46 Summary JSONL CSV
632 refresh_pipeline success ALL 9 8 1 0 2026-05-17 01:46 Summary JSONL CSV
631 refresh_sportscardspro success ALL 220 33 6 181 2026-05-16 01:53 Summary JSONL CSV
630 recalc_metrics success ALL 8548 8548 0 0 2026-05-16 01:50 Summary JSONL CSV