Rene Fichtmueller
0edc6e3f3a
feat: Pi scraper fleet — fetch-only index-pi.ts + FS.COM/NADDOD via SOCKS5
...
- index-pi.ts: removed Playwright scrapers (FS.COM, eBay enricher, switch assets)
added NADDOD (fetch-based, benefits from residential IP)
now 32 fetch-only queues safe for ARM/Pi without Chromium
- index-fs-only.ts: new dedicated FS.COM + NADDOD worker for Erik
routes through Pi SOCKS5 via PROXY_URLS=socks5://10.10.0.6:1080
Crawlee ProxyConfiguration automatically applies to Playwright crawler
- pi-scraper-setup.sh: removed inline index-pi.ts override (repo version now authoritative)
- CODEX-TASK-pi-scraper-deploy.md: full 9-step Codex spec for Pi fleet setup
covers WireGuard keypair, Erik peer config, setup script, ecosystem.config.js
- CODEX-TASK-zero-manual-review.md: deterministic equivalence matcher spec
2026-05-10 09:53:55 +02:00
Rene Fichtmueller
7e36236d2b
fix: quarantine GAO catalog artifacts
2026-05-10 09:48:43 +02:00
Rene Fichtmueller
cbb2580e60
sync: record TIP Cisco asset pass
2026-05-10 09:46:41 +02:00
Rene Fichtmueller
d691745c7b
feat: clean TIP cable rows from active base
2026-05-10 09:41:59 +02:00
Rene Fichtmueller
cf30735ef1
sync: record magatama all-lane training completion
2026-05-10 04:59:46 +02:00
Rene Fichtmueller
0599991431
sync: record TIP price closure follow-up
2026-05-10 01:49:42 +02:00
Rene Fichtmueller
2be61f2441
feat: close TIP retail price research states
2026-05-10 01:42:24 +02:00
Rene Fichtmueller
b58f7cee41
feat: resolve OEM price status and part details
2026-05-10 01:16:49 +02:00
Rene Fichtmueller
5819eb5eb0
sync: record magatama all-lane runpod training start
2026-05-10 01:11:21 +02:00
Rene Fichtmueller
b51901abdb
sync: record magatama training lane closure
2026-05-10 00:47:30 +02:00
Rene Fichtmueller
adb2661fac
feat: add targeted product page asset verifier
2026-05-10 00:31:33 +02:00
Rene Fichtmueller
0d4bcb6924
fix: preserve explicit competitor states in reconcile
2026-05-10 00:17:26 +02:00
Rene Fichtmueller
3926a1ef90
sync: record magatama multi-llm training lanes
2026-05-10 00:11:48 +02:00
Rene Fichtmueller
635a102932
feat: close open competitor research states
2026-05-10 00:03:42 +02:00
Rene Fichtmueller
fb9db56617
fix: quarantine fs numeric sku aliases
2026-05-09 23:35:01 +02:00
Rene Fichtmueller
7b8e229cf0
sync: record no-valid matcher closure
2026-05-09 23:24:55 +02:00
Rene Fichtmueller
79a57a5ac6
feat: add no-valid competitor resolver
2026-05-09 23:16:04 +02:00
Rene Fichtmueller
650de6ba9a
feat: add verification evidence state model
2026-05-09 23:06:21 +02:00
Rene Fichtmueller
de2943ea79
sync: record magatamallm adoption closure
2026-05-09 22:28:49 +02:00
Rene Fichtmueller
1af4f090f7
fix: harden TIP verification cleanup
2026-05-09 22:16:29 +02:00
Rene Fichtmueller
62eafa7574
sync: record tip blogllm runtime correction
2026-05-09 20:32:47 +02:00
Rene Fichtmueller
a43e572946
fix: advance TIP product verification robots
2026-05-09 20:19:19 +02:00
Rene Fichtmueller
3779de5b88
sync: record fo blogllm adoption closure
2026-05-09 20:10:27 +02:00
Rene Fichtmueller
56ed88ac8c
sync: record final detail queue closure
2026-05-09 18:25:56 +02:00
Rene Fichtmueller
ec40a96ae0
feat: add vendor detail verifiers
2026-05-09 18:22:09 +02:00
Rene Fichtmueller
7f4e7f03ad
sync: record atgbics special-case backfill
2026-05-09 17:55:41 +02:00
Rene Fichtmueller
b60fb362e8
sync: record magatama training live cleanup
2026-05-09 17:55:17 +02:00
Rene Fichtmueller
d61c3f7982
sync: record atgbics url evidence backfill
2026-05-09 17:51:03 +02:00
Rene Fichtmueller
6edb7a35b0
sync: record naddod and fs closure
2026-05-09 17:46:23 +02:00
Rene Fichtmueller
a43a693044
sync: record small vendor standard backfill
2026-05-09 17:41:49 +02:00
Rene Fichtmueller
a0e344549c
sync: record fibermall url backfill
2026-05-09 17:37:15 +02:00
Rene Fichtmueller
be4260a0fc
sync: record shopfiber24 code backfill
2026-05-09 17:33:33 +02:00
Rene Fichtmueller
91a1c2282a
fix: harden atgbics evidence parsing
2026-05-09 17:30:08 +02:00
Rene Fichtmueller
c2421c03a3
fix: harden shopfiber24 reach parsing
2026-05-09 17:24:06 +02:00
Rene Fichtmueller
6d8d7874d3
sync: record fibermall source backfill
2026-05-09 17:19:45 +02:00
Rene Fichtmueller
41f5a403a5
sync: record magatama training recovery
2026-05-09 17:18:35 +02:00
Rene Fichtmueller
9527d4f808
sync: record atgbics cable backfill
2026-05-09 17:12:52 +02:00
Rene Fichtmueller
a673048d7e
sync: record naddod infrastructure classification
2026-05-09 17:06:45 +02:00
Rene Fichtmueller
bb9c495497
fix: verify qsfptek cable details
2026-05-09 17:03:35 +02:00
Rene Fichtmueller
fc18b00157
fix: verify copper cable semantics
2026-05-09 16:55:50 +02:00
Rene Fichtmueller
c25300199a
fix: harden atgbics wavelength semantics
2026-05-09 16:41:18 +02:00
Rene Fichtmueller
ab0d21ec4f
sync: record highspeed wavelength backfill
2026-05-09 16:30:02 +02:00
Rene Fichtmueller
7044e564d6
sync: record strict active equivalence sweep
2026-05-09 16:24:10 +02:00
Rene Fichtmueller
61acccf5df
fix: require strict comparable transceiver evidence
2026-05-09 16:02:49 +02:00
Rene Fichtmueller
b26696f0d1
fix: improve vendor verification and fscom 1.6t variants
2026-05-09 15:56:08 +02:00
Rene Fichtmueller
7da78a999d
sync: record immediate equivalence revalidation
2026-05-09 14:14:48 +02:00
Rene Fichtmueller
49f0871720
chore: ignore crawlee python build artifacts
2026-05-09 14:06:55 +02:00
Rene Fichtmueller
60531b6250
feat: add crawlee python worker integration
2026-05-09 14:06:34 +02:00
Rene Fichtmueller
6ee10bf301
sync: record crawlee evaluation and fscom url discovery
2026-05-09 14:00:37 +02:00
Rene Fichtmueller
3d79f6b8e0
fix: add fscom url discovery mode
2026-05-09 14:00:30 +02:00