rene/transceiver-db
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
431 Commits 5 Branches 9 Tags
Commit Graph

90 Commits

Author SHA1 Message Date
Rene Fichtmueller
a20094755d feat(scraper): Flexoptix REST API sync robot + scheduler integration 
Replaces the GraphQL/search-based Flexoptix scraper with a proper
Magento 2 REST API integration that delivers authoritative SKUs,
prices, stock levels and compatibility data.

New files:
- packages/scraper/src/robots/flexoptix-api-sync.ts
  Self-contained robot: auth → paginated fetch → normalize → DB write.
  Reads FLEXOPTIX_API_BASE_URL / _USERNAME / _PASSWORD from env.
  Returns { fetched, normalized, skipped, priceWrites, stockWrites }.
  No file intermediary — in-memory pipeline.

- scripts/import-flexoptix-catalog.ts
  One-shot CLI importer for the Pulso-generated JSONL (Codex handover).

- docs/FLEXOPTIX_CATALOG_IMPORT.md
  Runbook for manual import + per-SKU specifications enrichment.

Scheduler changes:
- Added sync:flexoptix-catalog queue + work() handler
- Scheduled every 2h at 0 */2 * * * (same cadence as legacy job)
- scrape:pricing:flexoptix kept as legacy GraphQL fallback

Also includes Codex-generated additions from this sprint:
- audiocodes-oem scraper, seed-batch35/36/37, db.ts improvements,
  sql/102 verification reconcile, README + package.json updates
 2026-05-13 16:36:33 +02:00
Rene Fichtmueller
2b16551e4f docs: BlogLLM corpus expansion deployment & continuous evolution plan 
End-to-end deployment record for the 127→227 article corpus expansion:
- Gitea push (transceiver-db@f311e08)
- Magatama pool reconciliation (magatama@0e42de9)
- Erik sync via scp
- RunPod training trigger (job 0141303c, lane fo_blogllm, 500 iters)

Documents the continuous evolution plan (per-article + quarterly refresh)
and quality gates going forward.
 2026-05-12 23:38:16 +02:00
Rene Fichtmueller
122c4b8a81 fix: remove stock demo tab marker 2026-05-10 15:57:15 +02:00
Rene Fichtmueller
a0657ee565 fix: filter TIP hot topics quality 2026-05-10 15:54:38 +02:00
Rene Fichtmueller
e5917a2250 fix: show active TIP product scope 2026-05-10 15:46:41 +02:00
Rene Fichtmueller
58a2570842 fix: show TIP research status on overview 2026-05-10 15:01:22 +02:00
Rene Fichtmueller
5eb1b07183 fix: close stale TIP manual review queue 2026-05-10 10:23:07 +02:00
Rene Fichtmueller
cf0e471fa4 feat: close TIP research resolution states 2026-05-10 10:13:09 +02:00
Rene Fichtmueller
73c7250ebe Sync LLM training pool research expansion 2026-05-10 10:02:48 +02:00
Rene Fichtmueller
7e36236d2b fix: quarantine GAO catalog artifacts 2026-05-10 09:48:43 +02:00
Rene Fichtmueller
cbb2580e60 sync: record TIP Cisco asset pass 2026-05-10 09:46:41 +02:00
Rene Fichtmueller
d691745c7b feat: clean TIP cable rows from active base 2026-05-10 09:41:59 +02:00
Rene Fichtmueller
cf30735ef1 sync: record magatama all-lane training completion 2026-05-10 04:59:46 +02:00
Rene Fichtmueller
0599991431 sync: record TIP price closure follow-up 2026-05-10 01:49:42 +02:00
Rene Fichtmueller
2be61f2441 feat: close TIP retail price research states 2026-05-10 01:42:24 +02:00
Rene Fichtmueller
b58f7cee41 feat: resolve OEM price status and part details 2026-05-10 01:16:49 +02:00
Rene Fichtmueller
5819eb5eb0 sync: record magatama all-lane runpod training start 2026-05-10 01:11:21 +02:00
Rene Fichtmueller
b51901abdb sync: record magatama training lane closure 2026-05-10 00:47:30 +02:00
Rene Fichtmueller
adb2661fac feat: add targeted product page asset verifier 2026-05-10 00:31:33 +02:00
Rene Fichtmueller
0d4bcb6924 fix: preserve explicit competitor states in reconcile 2026-05-10 00:17:26 +02:00
Rene Fichtmueller
3926a1ef90 sync: record magatama multi-llm training lanes 2026-05-10 00:11:48 +02:00
Rene Fichtmueller
635a102932 feat: close open competitor research states 2026-05-10 00:03:42 +02:00
Rene Fichtmueller
fb9db56617 fix: quarantine fs numeric sku aliases 2026-05-09 23:35:01 +02:00
Rene Fichtmueller
7b8e229cf0 sync: record no-valid matcher closure 2026-05-09 23:24:55 +02:00
Rene Fichtmueller
79a57a5ac6 feat: add no-valid competitor resolver 2026-05-09 23:16:04 +02:00
Rene Fichtmueller
650de6ba9a feat: add verification evidence state model 2026-05-09 23:06:21 +02:00
Rene Fichtmueller
de2943ea79 sync: record magatamallm adoption closure 2026-05-09 22:28:49 +02:00
Rene Fichtmueller
1af4f090f7 fix: harden TIP verification cleanup 2026-05-09 22:16:29 +02:00
Rene Fichtmueller
62eafa7574 sync: record tip blogllm runtime correction 2026-05-09 20:32:47 +02:00
Rene Fichtmueller
a43e572946 fix: advance TIP product verification robots 2026-05-09 20:19:19 +02:00
Rene Fichtmueller
3779de5b88 sync: record fo blogllm adoption closure 2026-05-09 20:10:27 +02:00
Rene Fichtmueller
56ed88ac8c sync: record final detail queue closure 2026-05-09 18:25:56 +02:00
Rene Fichtmueller
ec40a96ae0 feat: add vendor detail verifiers 2026-05-09 18:22:09 +02:00
Rene Fichtmueller
7f4e7f03ad sync: record atgbics special-case backfill 2026-05-09 17:55:41 +02:00
Rene Fichtmueller
b60fb362e8 sync: record magatama training live cleanup 2026-05-09 17:55:17 +02:00
Rene Fichtmueller
d61c3f7982 sync: record atgbics url evidence backfill 2026-05-09 17:51:03 +02:00
Rene Fichtmueller
6edb7a35b0 sync: record naddod and fs closure 2026-05-09 17:46:23 +02:00
Rene Fichtmueller
a43a693044 sync: record small vendor standard backfill 2026-05-09 17:41:49 +02:00
Rene Fichtmueller
a0e344549c sync: record fibermall url backfill 2026-05-09 17:37:15 +02:00
Rene Fichtmueller
be4260a0fc sync: record shopfiber24 code backfill 2026-05-09 17:33:33 +02:00
Rene Fichtmueller
91a1c2282a fix: harden atgbics evidence parsing 2026-05-09 17:30:08 +02:00
Rene Fichtmueller
c2421c03a3 fix: harden shopfiber24 reach parsing 2026-05-09 17:24:06 +02:00
Rene Fichtmueller
6d8d7874d3 sync: record fibermall source backfill 2026-05-09 17:19:45 +02:00
Rene Fichtmueller
41f5a403a5 sync: record magatama training recovery 2026-05-09 17:18:35 +02:00
Rene Fichtmueller
9527d4f808 sync: record atgbics cable backfill 2026-05-09 17:12:52 +02:00
Rene Fichtmueller
a673048d7e sync: record naddod infrastructure classification 2026-05-09 17:06:45 +02:00
Rene Fichtmueller
bb9c495497 fix: verify qsfptek cable details 2026-05-09 17:03:35 +02:00
Rene Fichtmueller
fc18b00157 fix: verify copper cable semantics 2026-05-09 16:55:50 +02:00
Rene Fichtmueller
c25300199a fix: harden atgbics wavelength semantics 2026-05-09 16:41:18 +02:00
Rene Fichtmueller
ab0d21ec4f sync: record highspeed wavelength backfill 2026-05-09 16:30:02 +02:00