99 lines
2.7 KiB
Markdown
99 lines
2.7 KiB
Markdown
# Flexoptix Completion Push
|
|
|
|
Date: 2026-05-09
|
|
|
|
## Goal
|
|
|
|
Push Flexoptix products as far as possible toward complete automated verification without manually approving incomplete data.
|
|
|
|
## Code Changes
|
|
|
|
- `packages/scraper/src/scrapers/flexoptix-catalog.ts`
|
|
- Added generic reach parsing for values such as `50 m`, `1,000 m`, decimal values, and ranges.
|
|
- Improved wavelength parsing for multiple `λ... nm` values.
|
|
- Passed `productUrl` into `findOrCreateScrapedTransceiver`.
|
|
|
|
- `packages/scraper/src/scrapers/flexoptix-detail-pages.ts`
|
|
- Added a targeted Flexoptix detail-page verifier.
|
|
- Fetches only real Flexoptix `.html` product pages with missing signals.
|
|
- Parses static product page evidence:
|
|
- title
|
|
- description
|
|
- `og:image`
|
|
- `product:price:amount`
|
|
- reach
|
|
- fiber type
|
|
- wavelengths
|
|
- connector
|
|
- standard name
|
|
|
|
## Live Runs
|
|
|
|
- Built on Erik:
|
|
- `pnpm -C packages/scraper build`
|
|
- Ran improved Flexoptix catalog scraper:
|
|
- `Total unique products after GraphQL: 615`
|
|
- `Flexoptix Catalog Complete: 615 products, 0 prices`
|
|
- Ran detail-page verifier:
|
|
- target: `191`
|
|
- fetched: `191`
|
|
- failed: `0`
|
|
- new/updated price observations: `177`
|
|
- images marked: `187`
|
|
- details marked: `185`
|
|
|
|
## Verification Improvement
|
|
|
|
Before the completion push:
|
|
|
|
- details verified: `500`
|
|
- price + image + details verified: `496`
|
|
- fully verified: `496`
|
|
|
|
After catalog parser improvement:
|
|
|
|
- details verified: `606`
|
|
- price + image + details verified: `602`
|
|
- fully verified: `602`
|
|
|
|
After detail verifier and explicit BiDi correction:
|
|
|
|
- total Flexoptix rows: `744`
|
|
- HTML product-like rows: `626`
|
|
- price verified: `626`
|
|
- image verified: `622`
|
|
- details verified: `624`
|
|
- price + image + details verified: `620`
|
|
- fully verified: `620`
|
|
- filter/category rows with no verification: `108`
|
|
- other non-product/generic rows with no verification: `10`
|
|
|
|
## Source Evidence Correction
|
|
|
|
Four BiDi SFP products had `1,000 m` in the Flexoptix page title. They were corrected from Flexoptix source evidence:
|
|
|
|
- `S.B1312.M.DIL`
|
|
- `S.B1312.M.DL`
|
|
- `S.B1512.M.DIL`
|
|
- `S.B1512.M.DL`
|
|
|
|
Set:
|
|
|
|
- `reach_label=1000m`
|
|
- `reach_meters=1000`
|
|
- `fiber_type=MMF`
|
|
- `details_verified=true`
|
|
|
|
## Remaining Truth
|
|
|
|
Do not claim all `744` Flexoptix rows are complete. The remaining unverified rows are mostly filter/category/generic URLs rather than concrete product pages.
|
|
|
|
Remaining product-like gaps observed before SSH became unavailable:
|
|
|
|
- `4` product-like rows without image verification
|
|
- `2` FLEXBOX/accessory-like rows without reach/details
|
|
|
|
## Operational Note
|
|
|
|
After the last verification checks, SSH to Erik returned `connection refused`. Public TIP HTTPS still responded through Cloudflare. No further live commands were started after SSH refused.
|