edc9311d7b
- Add TIP Proxy Network (packages/proxy-agent): SOCKS5 proxy agent for residential IP bypass of CloudFront WAF blocks - Add /api/proxy/* routes: node registration, heartbeat, load balancing - Add image extraction to Flexoptix catalog scraper (GraphQL small_image) - Add image extraction to Optcore scraper (Playwright gallery img) - Fix Fluxlight price scraping (BigCommerce HTML structure: data-product-price-without-tax) - Add SmartOptics scraper (8 DWDM/coherent products, og:image extraction) - Fix findOrCreateScrapedTransceiver to update image_url for existing records - Add image backfill script (backfill-images.ts): 178 Flexoptix images added - Fix DB connection pool: max 5, idleTimeoutMillis 10s (was unlimited, caused >100 connections) - Add proxy.ts utility for scraper proxy rotation
@tip/proxy-agent
Contribute bandwidth to the TIP (Transceiver Intelligence Platform) proxy network and get free API access in return.
How it works
- You run the agent on a residential or home server machine
- The agent starts a SOCKS5 proxy server on your machine
- TIP scrapers route through your IP to bypass datacenter IP blocks (e.g. CloudFront WAF)
- You get: free TIP API access, contributor badge, early access to new features
Install & Start
# Generate a token first on https://transceiver-db.context-x.org/dashboard (Network tab)
# Then start the agent:
npx @tip/proxy-agent start --token YOUR_TOKEN
Options
tip-agent start --token TOKEN [--port 1080] [--max-gb 10] [--name "My Node"]
tip-agent status
tip-agent stop
| Option | Default | Description |
|---|---|---|
--token |
(required) | Your TIP node token |
--port |
1080 | SOCKS5 listen port |
--max-gb |
10 | Max bandwidth to donate |
--name |
hostname | Node display name |
--server |
https://transceiver-db.context-x.org | TIP API server |
Protocol
- SOCKS5 (RFC 1928)
- No-auth method
- TCP CONNECT only
- 30s connection timeout
- Heartbeat every 30s to routing server
Privacy
- Only outbound TCP CONNECT requests are proxied (no BIND, no UDP)
- Bandwidth is capped at your configured limit
- No logs of proxied content are stored
- Your IP is visible to the target website (residential proxy model)