rene/transceiver-db
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
transceiver-db/packages/scraper/src/scrapers
History
Rene Fichtmueller 77bad0e020 feat: stock confidence badges, multi-vendor price comparison, expanded Cisco TMG + Juniper HCT 
Stock API & Dashboard:
- /api/stock/summary: vendor_breakdown adds avg_confidence, currencies, conf_per_warehouse/aggregated/boolean
- /api/stock/summary: new price_comparison endpoint (multi-vendor SKUs, min/max/avg price)
- /api/stock/summary: totals adds multi_vendor_skus count
- Dashboard: 6th stat card (Multi-Vendor SKUs), confidence badge column (🟢 L3 / 🟡 L2 / ⚪ L1)
- Dashboard: price comparison table with vendor-by-vendor price breakdown
- Dashboard: subtitle updated to include QSFPTEK + NADDOD
- Dashboard: top sellers link to product URLs

Cisco TMG improvements:
- Added 5 new platform families: 8000 Series, NCS5500, NCS540, NCS560, NCS1000
- Per-device query strategy: iterates all switch model IDs from family filter
  instead of getting only 1 switch per family → 58 switches per N9300 run
- Graceful error handling per device with rate limiting (1s between requests)

Juniper HCT: ran manually → 475 Juniper-brand transceivers seeded
2026-04-17 23:33:31 +02:00
..
addon-networks.ts
feat: add NADDOD, QSFPTEK, and AddOn Networks scrapers
2026-03-30 21:20:23 +02:00
ai-clusters.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
ascentoptics.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
atgbics.ts
feat(scraper): add SOCKS5 proxy rotation for fs-com, atgbics, gbics scrapers
2026-04-08 08:17:49 +02:00
blueoptics.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
champion-one.ts
Merge remote-tracking branch 'github/main'
2026-04-06 18:03:36 +02:00
cisco-tmg.ts
feat: stock confidence badges, multi-vendor price comparison, expanded Cisco TMG + Juniper HCT
2026-04-17 23:33:31 +02:00
comms-express.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
community-issues.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
distributor-leads.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
ebay-enricher.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
ebay-velocity.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
edgecore.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
fiber24.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
fibermall.ts
fix(scraper): FiberMall URL schema + price parser + Flexoptix EUR comma bug
2026-04-12 04:26:35 +02:00
flexoptix-catalog.ts
fix(scraper): FiberMall URL schema + price parser + Flexoptix EUR comma bug
2026-04-12 04:26:35 +02:00
flexoptix-supported-vendors.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
flexoptix-vendors.ts
feat: add Flexoptix vendor scraper, 10Gtek pricing scraper, expand news feeds
2026-03-27 23:17:42 +13:00
fluxlight.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
fs-com.ts
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
gaotek.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
gbics.ts
feat(scraper): add SOCKS5 proxy rotation for fs-com, atgbics, gbics scrapers
2026-04-08 08:17:49 +02:00
github-signals.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
hubersuhner.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
juniper-hct.ts
feat: massive scraper expansion + hype cycle engine + lifecycle prediction
2026-03-28 02:30:19 +13:00
market-intelligence.ts
feat: Procurement Intelligence Engine (WS0c)
2026-04-01 22:04:33 +02:00
multimode-inc.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
naddod.ts
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
news.ts
feat(v0.2.0): Sales Intelligence Engine — Phase 0+A
2026-03-31 08:51:22 +02:00
nog-talks.ts
feat: NOG conference talks scraper + hot topics integration
2026-04-02 22:38:00 +02:00
optcore.ts
fix(scrapers): replace bot User-Agents with Chrome UA + disable dead domain
2026-04-06 02:17:50 +02:00
opticsbay.ts
feat(scraper): add FiberMall/Vcelink/OpticsBay scrapers, fix QSFPTEK API migration
2026-04-11 19:13:36 +02:00
optictransceiver.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
prolabs.ts
refactor(prolabs): replace Playwright+Firefox with fetch-based catalog scraper
2026-04-11 02:57:13 +02:00
qsfptek.ts
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
router-switch.ts
feat(scraper): add NADDOD/QSFPTEK/AddOn to scheduler, fix pre-existing TS build errors
2026-04-11 03:17:33 +02:00
sec-edgar.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
sfpcables.ts
Merge remote-tracking branch 'github/main'
2026-04-06 18:03:36 +02:00
skylane.ts
feat: linecard system support, Cisco 8000 accuracy, price anomaly detection
2026-04-09 09:06:22 +02:00
smartoptics.ts
feat(scraper+api): warehouse stock data pipeline — FS.com v2, SmartOptics v2, Stock API
2026-04-17 10:45:59 +02:00
sonic-hcl.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
standards-tracker.ts
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
switch-assets-crawler.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
switch-assets-playwright.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
switch-assets.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
switch-seed-bulk.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
switch-seed-extended.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
switch-seed-smb.ts
fix: switch seed lifecycle_status casing (Active not active)
2026-04-01 22:50:10 +02:00
switch-seed.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
tenGtek.ts
Merge remote-tracking branch 'github/main'
2026-04-06 18:03:36 +02:00
tscom.ts
feat: linecard system support, Cisco 8000 accuracy, price anomaly detection
2026-04-09 09:06:22 +02:00
ufispace.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
vcelink.ts
feat(scraper): add FiberMall/Vcelink/OpticsBay scrapers, fix QSFPTEK API migration
2026-04-11 19:13:36 +02:00
whitebox-seed.ts
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
wiitek.ts
feat: linecard system support, Cisco 8000 accuracy, price anomaly detection
2026-04-09 09:06:22 +02:00