todo-52.2-benchmark-url-transport-compatibility.md 912 B

Todo 52.2 Benchmark URL Transport Compatibility Plan

Status: done

Goal

Ensure every accepted benchmark base URL can be constructed by the production httpx transport.

Scope

  • Validate the complete URL with httpx.URL after structural and control-character checks.
  • Convert httpx.InvalidURL and invalid port/IDNA cases into stable Pydantic configuration errors.
  • Keep valid HTTP(S) Unicode hostnames that httpx accepts.

Files

  • Modify: src/agent_lab/application/benchmark.py
  • Modify: tests/test_benchmark_config.py

Verification

  • uv run pytest tests/test_benchmark_config.py tests/test_tool_invocation_comparison.py -q
  • uv run pytest
  • git diff --check

Observe / Update

  • Config validation now uses the production httpx URL semantics for IDNA and port compatibility.
  • Focused tests passed (72 passed) and the full suite passed at this checkpoint (477 passed).