transceiver-db/sync/CURRENT.md

Current TIP Sync State

Updated: 2026-04-29 20:40 UTC

Active Policy

• Put coordination notes and handoffs in this sync/ folder and push to Gitea.
• Check sibling project sync folders first when context may span repos.
• Use TIPLLM only for TIP crawler/robot planning and extraction feedback.
• Write robot/crawler experience into the Gitea-backed TIPLLM training pool.
• Keep Erik safe: no heavy crawler waves or uncontrolled Playwright/discovery jobs on Erik.
• Use Proxmox/Pi workers for crawl load.

Cross-Repo Sync

Claude Code also created a Gitea sync handoff in the LLM Gateway repo:

• Repo: rene/llm-gateway
• Path: sync/
• Commit shown by Claude: e272105 sync: add chat handoff + context scaffolding for Codex integration (2026-04-29)
• Gitea path: http://192.168.178.196:3000/rene/llm-gateway/src/main/sync/

When work touches TIP, Magatama, LLM Gateway, bridges, auth, or shared Erik infrastructure, read both:

• transceiver-db/sync/CURRENT.md
• llm-gateway/sync/CURRENT.md

Latest Work

• Full Codex session handoff was added:
  • sync/history/2026-04-29-codex-full-session-handoff.md
  • covers TIP verification, product image/detail crawling, Blog Engine Hot Topics, TIPLLM robots, training pool, Erik status, and cross-repo sync.
• Added a verification robot controller:
  • packages/scraper/src/robots/verification-robots.ts
  • command: npm run robots:verification -w packages/scraper -- --status
• Added TIPLLM robot experience writing:
  • packages/scraper/src/crawler-llm/training-data-writer.ts
  • writes raw robot audit rows and SFT records.
• Added Gitea training pool import to TIP learning-pool build:
  • scripts/tip-learning-pool-build.ts
  • imports TIP_TRAINING_REPO/qa-pairs/*.jsonl into the tip_llm lane.
• Added docs:
  • docs/TIP_SELFLEARNING_WORKFLOW.md
• Added package script:
  • packages/scraper/package.json
  • robots:verification

Gitea Training Pool

• Existing local clone: /tmp/tip-training-data
• Gitea repo: rene/tip-training-data
• Latest pushed training commit:
  • f1c83f8 crawl: add robot-status training records [2026-04-29T20:11:24.091Z]
• First robot experience record was written to:
  • /tmp/tip-training-data/qa-pairs/robot-control-high.jsonl
  • /tmp/tip-training-data/robot-experiences/2026-04-29.jsonl

Erik Status

• Synced TIPLLM robot/training code to /opt/tip.
• Did not start crawler jobs.
• Did not enqueue robot waves.
• Did not restart PM2 services.
• Remote scraper TypeScript build is passing after removing two stale misplaced remote-only duplicate files:
  • /opt/tip/packages/scraper/src/scrapers/scheduler.ts
  • /opt/tip/packages/scraper/src/vendor-discovery-crawler.ts
• tip-api and tip-scraper-daemon are online.

Last Live Verification Snapshot

From 2026-04-29:

• Total transceivers: 13,546
• Price verified: 7,250
• Image verified: 7,025
• Details verified: 6,243
• Fully verified: 5,812
• Last price observation: 2026-04-29 19:15:53 UTC
• Last stock observation: 2026-04-29 19:15:56 UTC

Safe Next Steps

1. Clone or pull Gitea origin on laptop/Claude Code.
2. Read this folder first.
3. If testing robots, start with dry runs only:

npm run robots:verification -w packages/scraper -- --status
npm run robots:verification -w packages/scraper -- --tipllm-plan --limit=3
npm run robots:verification -w packages/scraper -- --enqueue=details-fast-lane --profile=erik-safe --dry-run

4. Only dispatch real crawl work after deciding the target host:
   • Erik: erik-safe, tiny batches only.
   • Pi: pi-fetch.
   • Proxmox: proxmox-heavy.

Dirty Worktree Note

There are existing uncommitted changes outside sync/. Some are Codex work from this session, some appear pre-existing or from earlier Claude/Codex work. Do not blindly revert them. Review git status --short before committing broader changes.

Latest Sync Commits

• 6c42ca7 docs: add shared agent sync handoff
• 8e7c5aa docs: link llm-gateway sync handoff
• Pending after this update: full Codex session handoff in sync/history/.