rene/transceiver-db
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
transceiver-db/sql
History
Rene Fichtmueller d1bde66e39 feat: deterministic equivalence matcher + full wavelength/connector enrichment 
Replace confidence-based matcher with deterministic 6-field exact match:
- form_factor (exact), speed_gbps (±0.1G), fiber_type (exact),
  reach (±10%), wavelength_tx (±5nm), connector_type (exact)
- Complete products → confidence=1.0, never creates pending records
- Incomplete products → enhanced confidence ≥0.85, still auto_approved
- PENDING CREATED: 0 (by design, permanent)

Migrations:
- sql/113: Connector type inference from IEEE lookup + form-factor rules
  (970→479 missing connector for FX products)
- sql/114: Extend IEEE lookup with 400G/800G/1.6T OSFP/QSFP-DD standards,
  wavelength fallback (SMF→1310nm, MMF→850nm), clear pending queue to 0

Enrichment results (before→after):
- FX fully complete: 50 → 555 / 1,089 (+505)
- Total fully complete: ~3,600 → 15,431 / 18,133 (+11,800)
- FX coverage: 54.7% → 55.8% (608/1,089 matched)
- Deterministic matches: 0 → 44,596 (confidence=1.0)
- Wavelength-mismatched records rejected: 521
- Pending queue: 42 → 0 (permanent)

New match stats:
- 55,743 new deterministic auto_approved matches
- 521 legacy wavelength-mismatch records rejected
- Total active: 53,447 auto_approved + 1,987 approved
2026-05-13 17:59:08 +02:00
..
001-extensions.sql
feat: TIP Phase 0+1 — monorepo, DB schema, API, scraper engine
2026-03-27 16:27:31 +13:00
002-core-tables.sql
feat: TIP Phase 0+1 — monorepo, DB schema, API, scraper engine
2026-03-27 16:27:31 +13:00
003-timeseries.sql
feat: TIP Phase 0+1 — monorepo, DB schema, API, scraper engine
2026-03-27 16:27:31 +13:00
004-indexes.sql
feat: TIP Phase 0+1 — monorepo, DB schema, API, scraper engine
2026-03-27 16:27:31 +13:00
005-documents.sql
feat: Phase 5 — OCR pipeline + document/news search
2026-03-28 00:22:01 +13:00
006-seed-knowledge-base.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
006-whitebox-switches.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
007-flexoptix-vendors.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
008-product-assets.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
009-seed-switches.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
010-vendor-urls.sql
feat(scrapers+mcp): ATGBICS + ProLabs scrapers, MCP HTTP/SSE server
2026-03-29 02:26:45 +08:00
012-more-switches.sql
feat: dashboard v2, blog expansion, market/cable MCP tools, switch asset scrapers, scraper utilities
2026-03-30 08:07:12 +02:00
013-v020-sales-intelligence.sql
feat(v0.2.0): Sales Intelligence Engine — Phase 0+A
2026-03-31 08:51:22 +02:00
014-seed-transport-data.sql
feat(v0.2.0): Sales Intelligence Engine — Phase 0+A
2026-03-31 08:51:22 +02:00
015-blog-feedback.sql
feat(v0.2.1): data confidence tracking + validation + blog feedback system
2026-03-31 09:12:37 +02:00
016-data-confidence.sql
feat(v0.2.1): data confidence tracking + validation + blog feedback system
2026-03-31 09:12:37 +02:00
017-verification-tags.sql
fix(verification): 100% Verified Badge war dramatisch zu großzügig
2026-04-04 15:41:57 +02:00
018-cleanup-garbage-data.sql
fix: detect+warn garbage product names, add DB cleanup migration 018
2026-04-01 21:26:13 +02:00
019-procurement-intelligence.sql
feat: Procurement Intelligence Engine (WS0c)
2026-04-01 22:04:33 +02:00
020-product-intelligence.sql
feat: product intelligence layer — eBay enricher, community issues, datasheets+manuals API
2026-04-01 22:46:27 +02:00
021-procurement-demo-data.sql
fix: procurement demo data — correct schema column names for all 4 tables
2026-04-01 23:16:50 +02:00
022-prediction-signals.sql
feat: 6 prediction signal scrapers + forecast engine
2026-04-02 02:02:44 +02:00
023-proxy-node-improvements.sql
feat: proxy network — geo-lookup, uptime tracking, dedup fix
2026-04-04 08:15:32 +02:00
024-blog-linkedin-post.sql
feat: blog engine v5 — narrative control + linkedin post + min words fix
2026-04-04 08:30:27 +02:00
025-blog-sll.sql
fix: resolve merge conflict in index.ts + add untracked blog-sll, news, sql migration
2026-04-05 11:51:07 +02:00
025-verification-quality-fix.sql
fix(verification): 100% Verified Badge war dramatisch zu großzügig
2026-04-04 15:41:57 +02:00
026-price-cleanup-and-verification-fix.sql
feat(sql): migrations 026+027 for price cleanup and FS.COM EUR fix
2026-04-06 02:22:00 +02:00
027-fs-com-eur-currency-fix.sql
feat(sql): migrations 026+027 for price cleanup and FS.COM EUR fix
2026-04-06 02:22:00 +02:00
028-stock-observations-warehouse-columns.sql
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
029-seed-standards.sql
feat: TIP audit fixes — Qdrant init, switches columns, verification fix, crawler live status, demo data badges
2026-04-09 20:29:46 +02:00
030-blog-linkedin-columns.sql
feat: TIP audit fixes — Qdrant init, switches columns, verification fix, crawler live status, demo data badges
2026-04-09 20:29:46 +02:00
031-cisco-8000-accuracy.sql
data: add Cisco 8000 accuracy migration (031)
2026-04-09 09:09:23 +02:00
032-switches-columns-verification-fix.sql
feat: TIP audit fixes — Qdrant init, switches columns, verification fix, crawler live status, demo data badges
2026-04-09 20:29:46 +02:00
033-800g-standards-enrichment.sql
feat: 800G standards deep enrichment + Pi Starlink proxy-agent support
2026-04-09 20:34:27 +02:00
034-blog-review-tag.sql
feat(scraper+api): warehouse stock data pipeline — FS.com v2, SmartOptics v2, Stock API
2026-04-17 10:45:59 +02:00
035-price-observations-is-anomalous.sql
feat(scraper+api): warehouse stock data pipeline — FS.com v2, SmartOptics v2, Stock API
2026-04-17 10:45:59 +02:00
036-transceiver-equivalences.sql
feat(scraper+api): warehouse stock data pipeline — FS.com v2, SmartOptics v2, Stock API
2026-04-17 10:45:59 +02:00
037-stock-observations-indexes.sql
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
038-stock-observations-quality-columns.sql
feat: stock quality schema + QSFPTEK/NADDOD v2 scrapers with real-time stock counts
2026-04-17 22:54:40 +02:00
039-hype-cycle-analysis.sql
feat: Norton-Bass Hype Cycle Engine — market_metrics seed + Bass fitting + Gartner phase detection
2026-04-18 00:09:08 +02:00
039a-switch-certifications-column.sql
fix: add certifications column to switches table (migration 039a)
2026-04-20 23:16:52 +02:00
040-switch-facts-seed.sql
feat: switch facts — migration 040 seeds power/weight/certifications + dashboard shows them
2026-04-20 22:56:53 +02:00
041-switch-datasheets-seed.sql
fix(migration-041): use 'manual' doc_type instead of config_guide (CHECK constraint)
2026-04-20 23:17:41 +02:00
042-expand-verification-method.sql
fix: expand compatibility.verification_method CHECK to include vendor_compat + spec_match
2026-04-20 23:23:23 +02:00
043-clear-generic-switch-images.sql
feat: Flexoptix order section per switch + reject generic/logo images
2026-04-20 23:31:36 +02:00
044-fix-cisco-8000-product-urls.sql
fix: Cisco 8000 builder URL + MikroTik lowercase + new vendor builders
2026-04-21 00:41:31 +02:00
045-edgecore-images-direct.sql
data: inject Edgecore product images directly (Playwright blocked by 403)
2026-04-21 07:07:24 +02:00
046-qct-images-direct.sql
data: image coverage improvements — QCT, Allied Telesis + CHANGELOG update
2026-04-21 08:11:57 +02:00
047-moxa-images-direct.sql
fix: add image filter patterns and direct URL migrations for 6 vendors
2026-04-21 07:57:55 +02:00
048-ufispace-brocade-images-direct.sql
fix: add image filter patterns and direct URL migrations for 6 vendors
2026-04-21 07:57:55 +02:00
049-nvidia-images-direct.sql
fix: add image filter patterns and direct URL migrations for 6 vendors
2026-04-21 07:57:55 +02:00
050-allied-telesis-images-direct.sql
data: image coverage improvements — QCT, Allied Telesis + CHANGELOG update
2026-04-21 08:11:57 +02:00
051-tp-link-images-direct.sql
data: direct image injection for Nokia, F5, Delta Networks, Siemens, TP-Link
2026-04-21 08:42:14 +02:00
052-nokia-images-direct.sql
data: direct image injection for Nokia, F5, Delta Networks, Siemens, TP-Link
2026-04-21 08:42:14 +02:00
053-f5-images-direct.sql
data: direct image injection for Nokia, F5, Delta Networks, Siemens, TP-Link
2026-04-21 08:42:14 +02:00
054-delta-siemens-images-direct.sql
data: direct image injection for Nokia, F5, Delta Networks, Siemens, TP-Link
2026-04-21 08:42:14 +02:00
055-mikrotik-nvidia-cx7-images.sql
data: MikroTik CRS/CCR CDN images + NVIDIA ConnectX-7 (migration 055)
2026-04-21 09:48:30 +02:00
056-ale-h3c-hirschmann-ciena-netberg-images.sql
data: ALE/H3C/Hirschmann/Ciena/Netberg images 0%→100% (migration 056)
2026-04-21 09:50:46 +02:00
057-arista-edgecore-images.sql
data: Arista/Edgecore/Fortinet/Dell/Huawei/D-Link/Netgear/Check Point/Ruckus images (migrations 057-059)
2026-04-21 09:55:22 +02:00
058-fortinet-dell-huawei-images.sql
data: Arista/Edgecore/Fortinet/Dell/Huawei/D-Link/Netgear/Check Point/Ruckus images (migrations 057-059)
2026-04-21 09:55:22 +02:00
059-dlink-netgear-checkpoint-ruckus-images.sql
data: Arista/Edgecore/Fortinet/Dell/Huawei/D-Link/Netgear/Check Point/Ruckus images (migrations 057-059)
2026-04-21 09:55:22 +02:00
060-hpe-aruba-extreme-images.sql
data: HPE Aruba CX + Extreme Networks images 0%→100% (migration 060)
2026-04-21 09:56:11 +02:00
061-cambium-gigamon-sonicwall-planet-paloalto-westermo-zyxel-images.sql
data: Cambium/Gigamon/SonicWall/Planet/PaloAlto/Westermo/Zyxel/Synology/TRENDnet/Waystream/Kemp/LANCOM images (migrations 061-062)
2026-04-21 10:10:32 +02:00
062-synology-trendnet-waystream-kemp-lancom-images.sql
data: Cambium/Gigamon/SonicWall/Planet/PaloAlto/Westermo/Zyxel/Synology/TRENDnet/Waystream/Kemp/LANCOM images (migrations 061-062)
2026-04-21 10:10:32 +02:00
063-sophos-zyxel-fix-images.sql
data: Sophos XGS 6500 image + Zyxel XS3800-28 URL fix (migration 063)
2026-04-21 10:16:51 +02:00
064-avaya-netapp-keysight-a10-evertz-rad-ekinops-draytek-fujitsu-broadcom-calix-citrix-images.sql
data: Avaya/NetApp/Keysight/A10/Evertz/RAD/Ekinops/DrayTek/Fujitsu/Broadcom/Calix/Citrix images (migration 064)
2026-04-21 10:18:51 +02:00
065-cisco-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
066-juniper-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
067-arista-remaining-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
068-nvidia-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
069-huawei-nokia-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
070-dell-extreme-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
071-hpe-ubiquiti-supermicro-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
072-celestica-asterfusion-fs-edgecore-images.sql
data: switch image coverage 065-072 — Cisco/Juniper/Arista/NVIDIA/Huawei/Nokia/Dell/Extreme/HPE/Ubiquiti/Supermicro/Celestica/Asterfusion/FS.com/Edgecore
2026-04-21 11:34:38 +02:00
073-cisco-asr9k-ncs540-images.sql
data: add switch images migrations 073-074 (Cisco ASR9k/NCS540 + multi-vendor)
2026-04-21 14:30:42 +02:00
074-extreme-ruijie-ruckus-zte-edgecore-images.sql
data: add switch images migrations 073-074 (Cisco ASR9k/NCS540 + multi-vendor)
2026-04-21 14:30:42 +02:00
075-cisco-nexus9300-se1-images.sql
feat(data): image migrations 075-077 — Cisco NCS 9300 SE1, QCT, QNAP, Sophos, Barracuda, Peplink, Westermo
2026-04-21 14:49:29 +02:00
076-qct-qnap-sophos-images.sql
feat(data): image migrations 075-077 — Cisco NCS 9300 SE1, QCT, QNAP, Sophos, Barracuda, Peplink, Westermo
2026-04-21 14:49:29 +02:00
077-barracuda-peplink-westermo-images.sql
feat(data): image migrations 075-077 — Cisco NCS 9300 SE1, QCT, QNAP, Sophos, Barracuda, Peplink, Westermo
2026-04-21 14:49:29 +02:00
078-cisco-asr9000v-ncs1k-images.sql
feat(data): image migrations 078-079 — Cisco NCS1K4/ASR9000v, WAGO, WatchGuard, ADTRAN, Phoenix Contact
2026-04-21 15:01:39 +02:00
079-wago-watchguard-adtran-phoenix-images.sql
feat(data): image migrations 078-079 — Cisco NCS1K4/ASR9000v, WAGO, WatchGuard, ADTRAN, Phoenix Contact
2026-04-21 15:01:39 +02:00
080-avaya-advantech-images.sql
data: add image migrations 080-081 — Avaya, Advantech, Cisco N540/N540X/N560-IMA/ASR-9900-RP
2026-04-21 16:00:36 +02:00
081-cisco-n540x-n560ima-asr9900-images.sql
data: add image migrations 080-081 — Avaya, Advantech, Cisco N540/N540X/N560-IMA/ASR-9900-RP
2026-04-21 16:00:36 +02:00
082-cisco-a9k-linecards-images.sql
data: add image migrations 082-084 — Cisco A9K line cards, NC57/NCS1K14, A9K bulk
2026-04-21 21:20:47 +02:00
083-cisco-nc57-ncs1k14-images.sql
data: add image migrations 082-084 — Cisco A9K line cards, NC57/NCS1K14, A9K bulk
2026-04-21 21:20:47 +02:00
084-cisco-a9k-bulk-images.sql
data: add image migrations 082-084 — Cisco A9K line cards, NC57/NCS1K14, A9K bulk
2026-04-21 21:20:47 +02:00
085-mixed-straggler-images.sql
data: add image migration 085 — mixed straggler batch (9 switches)
2026-04-21 22:03:08 +02:00
086-asterfusion-arista-ruckus-misc-images.sql
data: add image migration 086 — Asterfusion/Arista/Ruckus/misc (8 models)
2026-04-21 22:13:54 +02:00
087-cisco-a9k-license-variant-reuse.sql
data: add image migration 087 — Cisco A9K license-variant reuse (3 models)
2026-04-21 22:20:19 +02:00
088-ubiquiti-phoenix-images.sql
data: add image migration 088 — Ubiquiti USW + Phoenix Contact (3 models)
2026-04-21 22:23:13 +02:00
089-arista-cisco-juniper-images.sql
feat(data): migration 089 — Arista 7800R4/Cisco 8000+Catalyst+Nexus/Juniper PTX images
2026-04-21 22:39:06 +02:00
090-edgecore-sonic-hcl-images.sql
feat(data): migration 090 + apply script — Edgecore AS-series SONiC switches
2026-04-21 23:02:25 +02:00
091-arista-juniper-sonic-hcl-images.sql
feat(data): migration 091 — Arista/Juniper SONiC HCL images (+7 models)
2026-04-21 23:09:46 +02:00
092-cisco-remaining-images.sql
data: migration 092 — Cisco image backfill (+48 models, 88.2%→95.1%)
2026-04-25 07:48:57 +02:00
093-nc55-main-linecards-images.sql
data: migration 093 — NCS 5500 main line card images (+6 models, 95.1%→96.0%)
2026-04-25 07:51:15 +02:00
094-cisco-8000-mpa-a9k-flex-images.sql
data: image backfill migrations 094/097/098 — Cisco ASR9K/8K-MPA/NC55, Edgecore AS7946, Ragile
2026-04-25 13:38:11 +02:00
095-vendor-compat-and-price-denorm.sql
fix: vendor_compat 0%→100%, price denorm, wiitek disabled, price-denorm scheduler
2026-04-25 08:55:21 +02:00
096-vendor-compat-by-form-factor.sql
fix: vendor_compat 0%→100%, price denorm, wiitek disabled, price-denorm scheduler
2026-04-25 08:55:21 +02:00
097-whitebox-misc-images.sql
fix: migration 097 correct vendor slug ragile → ragile-networks
2026-04-25 16:37:16 +02:00
098-cisco-a99x-images.sql
data: image backfill migrations 094/097/098 — Cisco ASR9K/8K-MPA/NC55, Edgecore AS7946, Ragile
2026-04-25 13:38:11 +02:00
099-flexoptix-internal-demand-schema.sql
feat: Flexoptix internal demand intelligence + real forecast calibration
2026-04-25 17:44:20 +02:00
100-standards-descriptions-and-gaps.sql
feat: standards audit + form factors reference
2026-04-25 20:58:45 +02:00
101-form-factors-table.sql
feat: standards audit + form factors reference
2026-04-25 20:58:45 +02:00
102-product-verification-reconcile.sql
feat(scraper): Flexoptix REST API sync robot + scheduler integration
2026-05-13 16:36:33 +02:00
103-verification-evidence-and-competitor-status.sql
feat: add verification evidence state model
2026-05-09 23:06:21 +02:00
104-verification-evidence-ambiguous.sql
feat: close open competitor research states
2026-05-10 00:03:42 +02:00
105-price-status-and-unavailable-evidence.sql
feat: resolve OEM price status and part details
2026-05-10 01:16:49 +02:00
106-research-resolution-status.sql
feat: close TIP research resolution states
2026-05-10 10:13:09 +02:00
107-close-stale-manual-review-queue.sql
fix: close stale TIP manual review queue
2026-05-10 10:23:07 +02:00
108-form-factor-normalization.sql
feat: implement Flexoptix reference matching overhaul
2026-05-13 16:55:45 +02:00
109-fix-nightly-matcher-time-window.sql
feat: implement Flexoptix reference matching overhaul
2026-05-13 16:55:45 +02:00
110-wavelength-connector-completeness.sql
feat: wavelength/connector enrichment schema + enricher robot
2026-05-13 17:35:42 +02:00
111-ieee-msa-wavelength-lookup.sql
fix: make wavelength_tx_nm nullable in ieee_wavelength_lookup for Copper/RJ45 entries
2026-05-13 17:38:43 +02:00
112-migrate-wavelengths-text-to-int.sql
feat: wavelength/connector enrichment schema + enricher robot
2026-05-13 17:35:42 +02:00
113-infer-connector-type.sql
feat: deterministic equivalence matcher + full wavelength/connector enrichment
2026-05-13 17:59:08 +02:00
114-extend-ieee-lookup-and-clear-pending.sql
feat: deterministic equivalence matcher + full wavelength/connector enrichment
2026-05-13 17:59:08 +02:00