arena.*
Evaluation and benchmarking RPC methods
The arena.* namespace is not registered on any current aleph-server build. The source tree has no arena handler module, no registry.register("arena.*", ...) calls, and no src/arena/ module — the runtime returns Method not found (code -32601) for every arena.* method.
The 26.7.x changelog has no entries for this namespace, and the original evaluation-arena concept (src/arena/, arena benchmark tasks, arena leaderboard) is not in the current build.
Methods
The methods below are never reachable on a running aleph-server. They are retained here only to document the previous design.
arena.list
List available evaluation tasks and benchmarks.
Request:
{ "jsonrpc": "2.0", "id": 1, "method": "arena.list", "params": {} }Response: Method not found (-32601).
arena.run
Run an evaluation benchmark.
| Parameter | Type | Required | Description |
|---|---|---|---|
benchmark_id | string | yes | Benchmark to run |
model | string | conditional | Model to evaluate (when the benchmark supports model selection) |
parallel | number | no | Number of parallel tasks |
Response: Method not found (-32601).
arena.status
Get the status of a running evaluation by run_id. Response: Method not found.
arena.results
Get the detailed results of a completed evaluation by run_id. Response: Method not found.
arena.compare
Compare results across multiple model runs. Takes a run_ids array. Response: Method not found.
See Also
- Methods Reference -- All currently registered namespaces
- GATEWAY reference -- Gateway protocol overview