Replaces the GraphQL/search-based Flexoptix scraper with a proper
Magento 2 REST API integration that delivers authoritative SKUs,
prices, stock levels and compatibility data.
New files:
- packages/scraper/src/robots/flexoptix-api-sync.ts
Self-contained robot: auth → paginated fetch → normalize → DB write.
Reads FLEXOPTIX_API_BASE_URL / _USERNAME / _PASSWORD from env.
Returns { fetched, normalized, skipped, priceWrites, stockWrites }.
No file intermediary — in-memory pipeline.
- scripts/import-flexoptix-catalog.ts
One-shot CLI importer for the Pulso-generated JSONL (Codex handover).
- docs/FLEXOPTIX_CATALOG_IMPORT.md
Runbook for manual import + per-SKU specifications enrichment.
Scheduler changes:
- Added sync:flexoptix-catalog queue + work() handler
- Scheduled every 2h at 0 */2 * * * (same cadence as legacy job)
- scrape:pricing:flexoptix kept as legacy GraphQL fallback
Also includes Codex-generated additions from this sprint:
- audiocodes-oem scraper, seed-batch35/36/37, db.ts improvements,
sql/102 verification reconcile, README + package.json updates
33 lines
1.1 KiB
JSON
33 lines
1.1 KiB
JSON
{
|
|
"name": "transceiver-intelligence-platform",
|
|
"version": "0.1.0",
|
|
"private": true,
|
|
"description": "Transceiver Intelligence Platform — the world's most comprehensive optical transceiver & network switch database",
|
|
"workspaces": [
|
|
"packages/*"
|
|
],
|
|
"scripts": {
|
|
"build": "npm run build --workspaces",
|
|
"build:core": "npm run build -w packages/core",
|
|
"build:api": "npm run build -w packages/api",
|
|
"dev": "npm run dev -w packages/api",
|
|
"learning-pool:build": "tsx scripts/tip-learning-pool-build.ts",
|
|
"learning-pool:publish-hf": "python3 scripts/tip-publish-hf-datasets.py",
|
|
"flexoptix:catalog:import": "tsx scripts/import-flexoptix-catalog.ts",
|
|
"migrate": "tsx scripts/migrate.ts",
|
|
"seed": "tsx scripts/seed-from-npm.ts",
|
|
"db:reset": "npm run migrate && npm run seed"
|
|
},
|
|
"author": "Rene Fichtmueller",
|
|
"license": "MIT",
|
|
"repository": {
|
|
"type": "git",
|
|
"url": "https://github.com/renefichtmueller/transceiver-db"
|
|
},
|
|
"devDependencies": {
|
|
"tsx": "^4.19",
|
|
"typescript": "^5.9.3",
|
|
"xlsx": "^0.18.5"
|
|
}
|
|
}
|