Rene Fichtmueller 5a77fce9f3 feat: NADDOD cursor rotation — covers all 7300+ URLs across 12 runs (24h) ...

Previously always sliced first 600 URLs from sitemap, missing 6700+ products.
Now stores offset in naddod-cursor.json, advances by 600 per run with wrap-around.
Full sitemap coverage in ~13 runs (26h). Also adds TIP_STORAGE_DIR env support.

2026-05-06 23:26:58 +02:00

..

src

feat: NADDOD cursor rotation — covers all 7300+ URLs across 12 runs (24h)

2026-05-06 23:26:58 +02:00

package.json

feat(scraper): add SOCKS5 proxy rotation for fs-com, atgbics, gbics scrapers

2026-04-08 08:17:49 +02:00

tsconfig.json

feat(scraper): add 100+ OEM seed scrapers + tip-llm-guided inference layer

2026-04-27 00:00:14 +02:00