Home Explore Help
Register Sign In
huzhenyu
/
agent-lab
1
0
Fork 0
Files Issues 0 Pull Requests 0 Wiki
Tree: 7a4647ac63
Branches Tags
agent-lab
/
docs
/
plans
/
todos.md

todos.md 7.7 KB
History Raw

Agent Lab MVP Todos

Workflow

  • Main session owns this file and evaluates progress after each todo.
  • Work on one todo at a time: write its plan, execute it, verify it, then update this file.
  • Do not plan all implementation details upfront. Later todos may change after each evaluation.
  • Detailed plans live beside this file as docs/plans/todo-N-*.md.
  • Status values: pending, in_progress, done, blocked.

Current State

  • Branch: codex/agent-lab-mvp.
  • MVP committed at 6babafa with FastAPI, WebSocket, static UI, OpenAI-compatible streaming, EventAgent handoff, provider-compatibility guards, and tests.
  • Post-MVP work now evolves toward the original queue/event-driven debugging-console requirements.

Coverage Review

  • OpenAI Chat Completions compatible streaming and provider payload guards are covered by todos 2, 5, and 7.
  • Queue/event-driven ChatAgent and EventAgent handoff is covered by todo 9.
  • EventAgent tool loading and UI management is covered by todo 10.
  • Prompt/pre-message editing, parameter controls, and reusable prompt sets are covered by todos 3 and 11.
  • Chat-window token, cached-token, TTFT, elapsed-time, and per-round stats are covered by todo 12.
  • Review follow-up gaps in real queue boundaries, API validation, packaging, and tool error isolation are covered by todos 13-16.

Todos

ID Status Plan Goal Verification
1 done docs/plans/todo-1-project-foundation.md Establish uv/FastAPI project skeleton, DDD package layout, and core failing tests for parser, event agent, and runtime routing. uv run pytest fails only because implementation is missing, not because tests or imports are malformed.
2 done docs/plans/todo-2-domain-runtime.md Implement domain models, OpenAI Chat Completions compatible stream parsing, EventAgent tools, and the direct async runtime loop. Core tests pass with mocked ChatAgent client.
3 done docs/plans/todo-3-websocket-api.md Add FastAPI config, HTTP routes, WebSocket protocol, static debug page, and assistant transcript persistence for multi-turn LLM calls. WebSocket contract tests pass; app imports successfully.
4 done docs/plans/todo-4-real-llm-smoke.md Document env-based real LLM run flow, add a lightweight manual smoke helper, and make sure settings names are clear. App starts with env-based config; docs show exact uv commands and required env vars.
5 done docs/plans/todo-5-tool-call-history.md Harden Chat Completions history so assistant tool calls and tool replies are sent in provider-compatible order. Tests prove the next model call includes assistant tool_calls before tool replies.
6 done docs/plans/todo-6-cleanup-closeout.md Clean temporary/generated files, update contributor docs, and run final verification. Git status contains only intended source/docs files; uv run pytest passes.
7 done docs/plans/todo-7-provider-compatibility.md Fix review findings for real Chat Completions compatible providers: default model fallback, role-aware message serialization, and configurable usage streaming. Tests prove provider payload shape and full suite passes.
8 done docs/plans/todo-8-tool-pre-message-guard.md Prevent manually configured pre-messages from producing invalid provider tool payloads without tool_call_id. Tests prove invalid tool pre-messages are rejected and UI no longer exposes tool role.
9 done docs/plans/todo-9-explicit-runtime-queues.md Refactor runtime internals to explicit input, output, and event queues while preserving the WebSocket stream contract. Tests prove ChatAgent consumes input queue, EventAgent consumes event queue, and output queue drives streamed responses.
10 done docs/plans/todo-10-tool-registry-management.md Replace the single hardcoded EventAgent tool checkbox with a backend tool registry and UI-managed loaded tools. Tests prove available tools are listed by API and selected tools control EventAgent behavior.
11 done docs/plans/todo-11-prompt-workspace.md Improve prompt/pre-message editing with browser-side persistence and reusable prompt sets. UI tests or focused JS tests prove prompts persist and can be restored.
12 done docs/plans/todo-12-round-stats.md Move round statistics to structured backend events for token counts, cached tokens, TTFT, elapsed time, and per-turn summaries. uv run pytest tests/test_debug_runtime.py tests/test_websocket_api.py; uv run pytest.
13 done docs/plans/todo-13-real-queue-websocket-loop.md Make runtime queues real producer/consumer boundaries and let WebSocket run separate upstream/downstream tasks. uv run pytest tests/test_debug_runtime.py tests/test_websocket_api.py; uv run pytest.
14 done docs/plans/todo-14-message-role-validation.md Reject provider-invalid API message roles and malformed tool replies before network calls. uv run pytest tests/test_websocket_api.py tests/test_event_agent.py; uv run pytest.
15 done docs/plans/todo-15-static-package-data.md Include static UI assets in installed package builds. uv run pytest tests/test_packaging.py; uv run pytest; uv build; wheel inspection.
16 done docs/plans/todo-16-tool-error-isolation.md Convert EventAgent tool handler exceptions into structured tool-result errors instead of aborting the session. uv run pytest tests/test_event_agent.py tests/test_debug_runtime.py; uv run pytest.
17 done docs/plans/todo-17-agent-config-audit-tools.md Align ChatAgent/EventAgent config, add extra_body defaults, default EventAgent to one event round, add mock tools, audit events, and backend logging. uv run pytest passes (42 passed, one existing Starlette deprecation warning).
18 done docs/plans/todo-18-prompt-modal-tool-ui.md Move prompt workspace into a modal and improve visible tool-management UI. uv run pytest passes (46 passed), plus local browser check confirms modal and tool UI render.
19 done docs/plans/todo-19-latency-oriented-polish.md Do one optimization pass focused on reducing perceived reply wait time and cleaning frontend/backend rough edges. uv run pytest passes (49 passed), plus local browser check confirms tools are visible in the first viewport.
20 done docs/plans/todo-20-agent-config-modals.md Split ChatAgent and EventAgent settings into separate configuration modals so the sidebar is no longer crowded. uv run pytest passes.
21 done docs/plans/todo-21-event-agent-context-summary.md Make EventAgent config part of parameter generation context and enqueue an aggregated tool-result summary for the next ChatAgent round. uv run pytest passes (50 passed, one existing Starlette deprecation warning).
22 done docs/plans/todo-22-text-event-protocol.md Replace ChatAgent tool calls with streamed text event parsing, inject generated event descriptions as a system message, and harden Agent config buttons. uv run pytest passes (50 passed, one existing Starlette deprecation warning), plus local browser click check.
23 done docs/plans/todo-23-agent-prompt-and-event-llm.md Move Prompt Config into ChatAgent config, show available-event prompt by default, and make EventAgent use LLM tool calls to generate tool arguments. uv run pytest passes (51 passed, one existing Starlette deprecation warning); changed Python modules compile; local server returned page/static assets/tools API.
24 done docs/plans/todo-24-chat-agent-prompt-list.md Put all ChatAgent prompts, including generated EventAgent event rules, into one ordered prompt list with add/delete/drag controls. uv run pytest passes (51 passed, one existing Starlette deprecation warning), plus local browser prompt-list check.