rene/transceiver-db
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
transceiver-db/packages/proxy-agent/README.md
Rene Fichtmueller edc9311d7b feat: add proxy network, image backfill, and scraper improvements 
- Add TIP Proxy Network (packages/proxy-agent): SOCKS5 proxy agent
  for residential IP bypass of CloudFront WAF blocks
- Add /api/proxy/* routes: node registration, heartbeat, load balancing
- Add image extraction to Flexoptix catalog scraper (GraphQL small_image)
- Add image extraction to Optcore scraper (Playwright gallery img)
- Fix Fluxlight price scraping (BigCommerce HTML structure: data-product-price-without-tax)
- Add SmartOptics scraper (8 DWDM/coherent products, og:image extraction)
- Fix findOrCreateScrapedTransceiver to update image_url for existing records
- Add image backfill script (backfill-images.ts): 178 Flexoptix images added
- Fix DB connection pool: max 5, idleTimeoutMillis 10s (was unlimited, caused >100 connections)
- Add proxy.ts utility for scraper proxy rotation
2026-04-03 21:13:03 +02:00

1.7 KiB
Raw Blame History

@tip/proxy-agent

Contribute bandwidth to the TIP (Transceiver Intelligence Platform) proxy network and get free API access in return.

How it works

  • You run the agent on a residential or home server machine
  • The agent starts a SOCKS5 proxy server on your machine
  • TIP scrapers route through your IP to bypass datacenter IP blocks (e.g. CloudFront WAF)
  • You get: free TIP API access, contributor badge, early access to new features

Install & Start

# Generate a token first on https://transceiver-db.context-x.org/dashboard (Network tab)
# Then start the agent:
npx @tip/proxy-agent start --token YOUR_TOKEN

Options

tip-agent start --token TOKEN [--port 1080] [--max-gb 10] [--name "My Node"]
tip-agent status
tip-agent stop
Option Default Description
--token (required) Your TIP node token
--port 1080 SOCKS5 listen port
--max-gb 10 Max bandwidth to donate
--name hostname Node display name
--server https://transceiver-db.context-x.org TIP API server

Protocol

  • SOCKS5 (RFC 1928)
  • No-auth method
  • TCP CONNECT only
  • 30s connection timeout
  • Heartbeat every 30s to routing server

Privacy

  • Only outbound TCP CONNECT requests are proxied (no BIND, no UDP)
  • Bandwidth is capped at your configured limit
  • No logs of proxied content are stored
  • Your IP is visible to the target website (residential proxy model)