1026787318
- Add TIP Proxy Network (packages/proxy-agent): SOCKS5 proxy agent for residential IP bypass of CloudFront WAF blocks - Add /api/proxy/* routes: node registration, heartbeat, load balancing - Add image extraction to Flexoptix catalog scraper (GraphQL small_image) - Add image extraction to Optcore scraper (Playwright gallery img) - Fix Fluxlight price scraping (BigCommerce HTML structure: data-product-price-without-tax) - Add SmartOptics scraper (8 DWDM/coherent products, og:image extraction) - Fix findOrCreateScrapedTransceiver to update image_url for existing records - Add image backfill script (backfill-images.ts): 178 Flexoptix images added - Fix DB connection pool: max 5, idleTimeoutMillis 10s (was unlimited, caused >100 connections) - Add proxy.ts utility for scraper proxy rotation
51 lines
1.7 KiB
Markdown
51 lines
1.7 KiB
Markdown
# @tip/proxy-agent
|
|
|
|
Contribute bandwidth to the TIP (Transceiver Intelligence Platform) proxy network
|
|
and get free API access in return.
|
|
|
|
## How it works
|
|
|
|
- You run the agent on a residential or home server machine
|
|
- The agent starts a SOCKS5 proxy server on your machine
|
|
- TIP scrapers route through your IP to bypass datacenter IP blocks (e.g. CloudFront WAF)
|
|
- You get: free TIP API access, contributor badge, early access to new features
|
|
|
|
## Install & Start
|
|
|
|
```bash
|
|
# Generate a token first on https://transceiver-db.context-x.org/dashboard (Network tab)
|
|
# Then start the agent:
|
|
npx @tip/proxy-agent start --token YOUR_TOKEN
|
|
```
|
|
|
|
## Options
|
|
|
|
```
|
|
tip-agent start --token TOKEN [--port 1080] [--max-gb 10] [--name "My Node"]
|
|
tip-agent status
|
|
tip-agent stop
|
|
```
|
|
|
|
| Option | Default | Description |
|
|
|------------|---------------------------------------------|--------------------------|
|
|
| `--token` | (required) | Your TIP node token |
|
|
| `--port` | 1080 | SOCKS5 listen port |
|
|
| `--max-gb` | 10 | Max bandwidth to donate |
|
|
| `--name` | hostname | Node display name |
|
|
| `--server` | https://transceiver-db.context-x.org | TIP API server |
|
|
|
|
## Protocol
|
|
|
|
- SOCKS5 (RFC 1928)
|
|
- No-auth method
|
|
- TCP CONNECT only
|
|
- 30s connection timeout
|
|
- Heartbeat every 30s to routing server
|
|
|
|
## Privacy
|
|
|
|
- Only outbound TCP CONNECT requests are proxied (no BIND, no UDP)
|
|
- Bandwidth is capped at your configured limit
|
|
- No logs of proxied content are stored
|
|
- Your IP is visible to the target website (residential proxy model)
|