Operations

Jobs and Data Pipeline

Run the automated refresh flow, backfill imports, and watch the latest collectibles pipeline activity from one dark control room.

View Rankings
Automated Pipeline
The automation flow seeds candidate cards from the population source, reprioritizes sports cards using player sources when available, refreshes sold comps and active raw listings from eBay, then recalculates rankings. Pokemon runs also refresh the TCG catalog and Pokemon candidate seed before the rest of the pipeline. If a Pokemon prep stage fails during an ALL run, the pipeline can continue and the failure will show up in the run summary plus the JSONL/CSV reports.
PopulationNot configured — eBay discovery used as fallback
NFL PlayersConfigured
MLB PlayersConfigured
NBA PlayersConfigured
eBayConfigured
Sold CompsRequires Marketplace Insights approval; check scopes from Docs.
SchedulerAuto-refresh every 24h
Grading TierEconomy (set GRADING_TIER in .env)
Pokemon CatalogLoaded
Pokemon PopulationOptional — set POKEMON_POPULATION_SOURCE_FILE or _URL
Used by pipeline, comps, listings, provider backfills, and metrics.
Max 200 (eBay limit per page)
PSA
BGS/Beckett
SGC
Manual Imports

Use these tools for CSV backfills or to patch source coverage gaps. The automated pipeline remains the primary path.

Sales template | Population template
Candidate Seed

Expand the candidate universe outside the automated feeds with a curated seed source, one-off manual adds, or candidate CSV uploads.

Configured FeedOptional / missing config
Pokemon FeedConfigured
Player EnrichmentSoft validation enabled
Download Candidate CSV
Candidate template
Manual eBay Backfill / Discovery

Use this for manual discovery or backfills only. It does not run as part of the full pipeline.

Recent Job Runs
ID Job Status Scope Processed Inserted Skipped Rejected Started Reports
1572 refresh_sportscardspro success ALL 30 0 0 30 2026-09-15 10:01 Summary JSONL CSV
1571 recalc_metrics success ALL 9114 9114 0 0 2026-09-15 09:57 Summary JSONL CSV
1570 refresh_active_raw success ALL 80 23 42 15 2026-09-15 09:56 Summary JSONL CSV
1569 refresh_sold_comps success ALL 0 0 1 0 2026-09-15 09:56 Summary JSONL CSV
1568 refresh_player_pool success ALL 1022 1022 0 1 2026-09-15 09:56 Summary JSONL CSV
1567 discover_candidates_from_ebay success ALL 1774 0 1774 0 2026-09-15 09:55 Summary JSONL CSV
1566 refresh_candidate_seed success POKEMON 7911 0 7911 0 2026-09-15 09:55 Summary JSONL CSV
1565 refresh_tcg_catalog success POKEMON 60 60 0 0 2026-09-15 09:54 Summary JSONL CSV
1564 refresh_pipeline success ALL 9 8 1 0 2026-09-15 09:54 Summary JSONL CSV
1563 refresh_sportscardspro success ALL 30 0 0 30 2026-09-14 10:01 Summary JSONL CSV
1562 recalc_metrics success ALL 9114 9114 0 0 2026-09-14 09:57 Summary JSONL CSV
1561 refresh_active_raw success ALL 216 89 70 57 2026-09-14 09:56 Summary JSONL CSV
1560 refresh_sold_comps success ALL 0 0 1 0 2026-09-14 09:56 Summary JSONL CSV
1559 refresh_player_pool success ALL 1022 1022 0 1 2026-09-14 09:56 Summary JSONL CSV
1558 discover_candidates_from_ebay success ALL 1775 2 1773 0 2026-09-14 09:56 Summary JSONL CSV
1557 refresh_candidate_seed success POKEMON 7911 0 7911 0 2026-09-14 09:55 Summary JSONL CSV
1556 refresh_tcg_catalog success POKEMON 60 60 0 0 2026-09-14 09:54 Summary JSONL CSV
1555 refresh_pipeline success ALL 9 8 1 0 2026-09-14 09:54 Summary JSONL CSV
1554 refresh_sportscardspro success ALL 28 0 0 28 2026-09-13 09:53 Summary JSONL CSV
1553 recalc_metrics success ALL 9112 9112 0 0 2026-09-13 09:50 Summary JSONL CSV