gemma3:4b
Family: gemma3 · 4B parameters · 1 run(s)
No native tool support — score not comparable.
The Ollama chat template for this model has no native tool-calling support, so the harness cannot issue tool calls. Its 0 on JSON/schema/tool/multi-step and 100 on injection reflect that, not model quality. Not comparable to other models. The raw sub-scores below are shown for transparency only; this model is listed without a numeric score at the bottom of its tier. Methodology
8 GB VRAM · ollama 0.40.6 · Q4_K_M
n/a No native tool support
| JSON | Schema | Tool | Multi-step | Injection | tok/s | p50 s/task | p95 s/task |
|---|---|---|---|---|---|---|---|
| 0 | 0 | 0 | 0 | 100 | 159.1 | 11.6 | 12.1 |
- Run:
20261020-gemma3-4b-d16860· 2026-10-20T20:46:24+00:00 - GPU: NVIDIA GeForce RTX 3090 (24 GB) · Linux 6.8.0-57-generic
- Harness: hermes-agent Hermes Agent v0.22.2+2363.g9cb34e9 (2026.9.24) · stable · local 9cb34e9e285d · trials 3 · temp 0 · ctx 8192 · seed 42
- GGUF sha256:
f06e91e18fc74295d0c781bf91622508c75655e2c18ed869d52447ffe1e667e1 - Sponsor disclosure: none