llm-gateway/scripts/ensure-bridges.sh
Rene Fichtmueller 128e18b751 feat: integrate GitHub Copilot as third LLM provider via copilot-bridge
Add GitHub Copilot API proxy integration to LLM Gateway:

* Implement copilot-bridge service:
  - HTTP wrapper managing copilot-api (GitHub Copilot API proxy)
  - OpenAI-compatible /v1/chat/completions endpoint (port 3252)
  - Graceful startup and SIGTERM shutdown handling
  - Health check endpoint with service diagnostics

* Register copilot-bridge in provider fallback chain:
  - Position: After OpenAI, before free LLM APIs (tier 4)
  - Rate limit: 60 requests/min (GitHub Copilot API limit)
  - Models: gpt-4 (reasoning), gpt-3.5-turbo (medium)
  - Authentication: GitHub Copilot subscription (internal to copilot-api)

* Update PM2 ecosystem configuration:
  - Add copilot-bridge service definition (port 3252)
  - Configure COPILOT_BRIDGE_URL in gateway environment
  - Add copilot to LLM_PROVIDERS list

* Enhance deployment automation:
  - Update ensure-bridges.sh with copilot-bridge deployment
  - Copy service files from repo to /opt/copilot-bridge
  - Run npm install for copilot-api dependency

* Comprehensive documentation:
  - Expand DEPLOYMENT-BRIDGES.md with copilot-bridge section
  - Prerequisites: Node.js 20+, GitHub Copilot subscription
  - Authentication workflow: npm run auth with GitHub OAuth
  - Troubleshooting: subscription verification, auth cache reset

Provider chain now supports:
1. Ollama (local, free)
2. claude-bridge (Claude subscription)
3. openai-bridge (OpenAI subscription)
4. copilot-bridge (GitHub Copilot subscription) ← NEW
5. Free APIs: Cerebras, Groq, Mistral, NVIDIA, Cloudflare

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2026-04-25 12:38:30 +02:00

202 lines
6.1 KiB
Bash
Executable File

#!/bin/bash
# Ensure bridge services are deployed and ready
# This script runs as part of PM2 initialization to deploy bridges if not present
set -e
OPENAI_BRIDGE_DIR="/opt/openai-bridge"
CLAUDE_BRIDGE_DIR="/opt/claude-bridge"
COPILOT_BRIDGE_DIR="/opt/copilot-bridge"
GATEWAY_DIR="/opt/llm-gateway"
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Checking bridge services..."
# Ensure openai-bridge exists
if [ ! -d "$OPENAI_BRIDGE_DIR" ]; then
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Deploying openai-bridge..."
mkdir -p "$OPENAI_BRIDGE_DIR"
# Deploy server.js
cat > "$OPENAI_BRIDGE_DIR/server.js" << 'BRIDGE_EOF'
import { execFile } from 'child_process'
import { createServer } from 'http'
import { promisify } from 'util'
import { readFileSync } from 'fs'
const exec = promisify(execFile)
const PORT = process.env.OPENAI_BRIDGE_PORT || 3251
const API_KEY = process.env.OPENAI_API_KEY
const DEFAULT_MODEL = process.env.OPENAI_MODEL || 'gpt-4-turbo'
const SYSTEM_CODEX = `You are an expert code generation AI.
Generate clean, well-documented, production-ready code.
Output only the code — no explanations, no markdown blocks, no preamble.`
const SYSTEM_CHATGPT = `You are a helpful AI assistant.
Provide clear, concise, accurate responses.
Output only the response — no preamble.`
async function callOpenAI(messages, model, temperature = 0.3, maxTokens = 2048) {
if (!API_KEY) {
throw new Error('OPENAI_API_KEY not configured')
}
const args = [
'api', 'chat.completions.create',
'-m', model,
'-t', String(temperature),
'-M', String(maxTokens),
]
for (const msg of messages) {
args.push('-g', msg.role, msg.content)
}
return new Promise((resolve) => {
const env = {
...process.env,
OPENAI_API_KEY: API_KEY
}
exec('openai', args, { env, timeout: 300_000, maxBuffer: 1024 * 1024 * 10 }, (err, stdout) => {
if (err) {
resolve({
success: false,
content: null,
error: err.message.slice(0, 500),
stderr: err.stderr?.slice(0, 500)
})
} else {
try {
const result = JSON.parse(stdout)
const content = result.choices?.[0]?.message?.content || result.message?.content || stdout
resolve({ success: true, content, error: null })
} catch (e) {
resolve({ success: true, content: stdout.trim(), error: null })
}
}
})
})
}
const server = createServer(async (req, res) => {
res.setHeader('Content-Type', 'application/json')
res.setHeader('Access-Control-Allow-Origin', '*')
res.setHeader('Access-Control-Allow-Methods', 'POST, GET, OPTIONS')
res.setHeader('Access-Control-Allow-Headers', 'Content-Type')
if (req.method === 'OPTIONS') { res.writeHead(200); res.end(); return }
if (req.method === 'GET' && req.url === '/health') {
res.writeHead(200)
res.end(JSON.stringify({
status: 'ok',
version: '1.0.0',
provider: 'openai',
model: DEFAULT_MODEL,
configured: !!API_KEY
}))
return
}
if (req.method === 'POST' && req.url === '/v1/chat/completions') {
let body = ''
req.on('data', chunk => body += chunk)
req.on('end', async () => {
try {
const { model, messages, temperature, max_tokens, type } = JSON.parse(body)
if (!messages || !Array.isArray(messages)) {
res.writeHead(400)
res.end(JSON.stringify({ error: 'messages array required' }))
return
}
const selectedModel = model || DEFAULT_MODEL
const temp = temperature ?? 0.3
const maxTok = max_tokens ?? 2048
console.log(`[${new Date().toISOString()}] OpenAI ${selectedModel} (${type || 'chat'})`)
const result = await callOpenAI(messages, selectedModel, temp, maxTok)
if (result.success) {
res.writeHead(200)
res.end(JSON.stringify({
success: true,
content: result.content,
provider: 'openai',
model: selectedModel
}))
} else {
res.writeHead(500)
res.end(JSON.stringify({
success: false,
error: result.error,
stderr: result.stderr
}))
}
} catch (e) {
console.error('Error:', e.message)
res.writeHead(500)
res.end(JSON.stringify({ error: e.message }))
}
})
return
}
res.writeHead(404)
res.end(JSON.stringify({ error: 'not found' }))
})
server.listen(PORT, () => {
console.log(`openai-bridge running on port ${PORT}`)
console.log(` POST http://localhost:${PORT}/v1/chat/completions`)
console.log(` GET http://localhost:${PORT}/health`)
console.log(` Model: ${DEFAULT_MODEL}`)
console.log(` API Key configured: ${!!API_KEY}`)
})
BRIDGE_EOF
# Deploy package.json
cat > "$OPENAI_BRIDGE_DIR/package.json" << 'PACKAGE_EOF'
{
"name": "openai-bridge",
"version": "1.0.0",
"description": "OpenAI API bridge for ChatGPT and Codex integration",
"type": "module",
"main": "server.js",
"scripts": {
"start": "node server.js",
"pm2": "pm2 start server.js --name openai-bridge"
}
}
PACKAGE_EOF
echo "[$(date +'%Y-%m-%d %H:%M:%S')] ✓ openai-bridge deployed"
fi
# Ensure copilot-bridge exists
if [ ! -d "$COPILOT_BRIDGE_DIR" ]; then
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Deploying copilot-bridge..."
mkdir -p "$COPILOT_BRIDGE_DIR"
# Deploy from source if available
if [ -d "$GATEWAY_DIR/copilot-bridge" ]; then
cp "$GATEWAY_DIR/copilot-bridge/server.js" "$COPILOT_BRIDGE_DIR/"
cp "$GATEWAY_DIR/copilot-bridge/package.json" "$COPILOT_BRIDGE_DIR/"
cd "$COPILOT_BRIDGE_DIR"
npm install
echo "[$(date +'%Y-%m-%d %H:%M:%S')] ✓ copilot-bridge deployed from source"
else
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Note: copilot-bridge source not found. Copy files manually to $COPILOT_BRIDGE_DIR"
fi
fi
# Ensure claude-bridge exists (similar check)
if [ ! -d "$CLAUDE_BRIDGE_DIR" ]; then
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Note: claude-bridge directory not found. Run deployment script separately if needed."
fi
echo "[$(date +'%Y-%m-%d %H:%M:%S')] Bridge initialization complete"