Guido.Tech/ai_intelligence_layer/TESTING.md

Testing the AI Intelligence Layer

Quick Test Options

Option 1: Python Script (RECOMMENDED - No dependencies)

python3 test_api.py

Advantages:

• ✅ No external tools required
• ✅ Clear, formatted output
• ✅ Built-in error handling
• ✅ Works on all systems

Option 2: Shell Script

./test_api.sh

Note: Uses pure Python for JSON processing (no jq required)

Option 3: Manual Testing

Health Check

curl http://localhost:9000/api/health | python3 -m json.tool

Brainstorm Test

python3 << 'EOF'
import json
import urllib.request

# Load data
with open('sample_data/sample_enriched_telemetry.json') as f:
    telemetry = json.load(f)
with open('sample_data/sample_race_context.json') as f:
    context = json.load(f)

# Make request
data = json.dumps({
    "enriched_telemetry": telemetry,
    "race_context": context
}).encode('utf-8')

req = urllib.request.Request(
    'http://localhost:9000/api/strategy/brainstorm',
    data=data,
    headers={'Content-Type': 'application/json'}
)

with urllib.request.urlopen(req, timeout=120) as response:
    result = json.loads(response.read())
    print(f"Generated {len(result['strategies'])} strategies")
    for s in result['strategies'][:3]:
        print(f"{s['strategy_id']}. {s['strategy_name']} - {s['risk_level']} risk")
EOF

Expected Output

Successful Test Run

======================================================================
AI Intelligence Layer - Test Suite
======================================================================
1. Testing health endpoint...
   ✓ Status: healthy
   ✓ Service: AI Intelligence Layer
   ✓ Demo mode: False

2. Testing brainstorm endpoint...
   (This may take 15-30 seconds...)
   ✓ Generated 20 strategies in 18.3s

   Sample strategies:
     1. Conservative 1-Stop
        Stops: 1, Risk: low
     2. Standard Medium-Hard
        Stops: 1, Risk: medium
     3. Aggressive Undercut
        Stops: 2, Risk: high

3. Testing analyze endpoint...
   (This may take 20-40 seconds...)
   ✓ Analysis complete in 24.7s

   Top 3 strategies:

     1. Aggressive Undercut (RECOMMENDED)
        Predicted: P3
        P3 or better: 75%
        Risk: medium

     2. Standard Two-Stop (ALTERNATIVE)
        Predicted: P4
        P3 or better: 63%
        Risk: medium

     3. Conservative 1-Stop (CONSERVATIVE)
        Predicted: P5
        P3 or better: 37%
        Risk: low

======================================================================
RECOMMENDED STRATEGY DETAILS:
======================================================================

Engineer Brief:
  Undercut Leclerc on lap 32. 75% chance of P3 or better.

Driver Radio:
  "Box this lap. Soft tires going on. Push mode for next 8 laps."

ECU Commands:
  Fuel: RICH
  ERS: AGGRESSIVE_DEPLOY
  Engine: PUSH

======================================================================

======================================================================
✓ ALL TESTS PASSED!
======================================================================

Results saved to:
  - /tmp/brainstorm_result.json
  - /tmp/analyze_result.json

Troubleshooting

"Connection refused"

# Service not running. Start it:
python main.py

"Timeout" errors

# Check .env settings:
cat .env | grep TIMEOUT

# Should see:
# BRAINSTORM_TIMEOUT=90
# ANALYZE_TIMEOUT=120

# Also check Fast Mode is enabled:
cat .env | grep FAST_MODE
# Should see: FAST_MODE=true

"422 Unprocessable Content"

This usually means invalid JSON in the request. The new test scripts handle this automatically.

Test takes too long

# Enable fast mode in .env:
FAST_MODE=true

# Restart service:
# Press Ctrl+C in the terminal running python main.py
# Then: python main.py

Performance Benchmarks

With FAST_MODE=true and gemini-2.5-flash:

Test	Expected Time	Status
Health	<1s	✅
Brainstorm	15-30s	✅
Analyze	20-40s	✅
Total	40-70s	✅

Component Tests

To test just the data models and validators (no API calls):

python test_components.py

This runs instantly and doesn't require the Gemini API.

Files Created During Tests

• /tmp/test_request.json - Brainstorm request payload
• /tmp/brainstorm_result.json - 20 generated strategies
• /tmp/analyze_request.json - Analyze request payload
• /tmp/analyze_result.json - Top 3 analyzed strategies

You can inspect these files to see the full API responses.

Integration with Enrichment Service

If the enrichment service is running on localhost:8000, the AI layer will automatically fetch telemetry data when not provided in the request:

# Test without providing telemetry (will fetch from enrichment service)
curl -X POST http://localhost:9000/api/strategy/brainstorm \
  -H "Content-Type: application/json" \
  -d '{
    "race_context": {
      "race_info": {"track_name": "Monaco", "current_lap": 27, "total_laps": 58},
      "driver_state": {"driver_name": "Hamilton", "current_position": 4}
    }
  }'

---

Ready to test! 🚀

Just run: python3 test_api.py