Employee questions answered accurately from the handbook
| fixture | answers-from-context | known-answer | answer-length | cites-source | no-hallucination | stays-in-scope |
|---|---|---|---|---|---|---|
| all | 75% [47–91%] n=12 | 78% [45–94%] n=9 | 100% [76–100%] n=12 | 92% [65–99%] n=12 | 75% [47–91%] n=12 | 83% [55–95%] n=12 |
| expense-reimbursement | 2/3 | 2/3 | 3/3 | 3/3 | 2/3 | 3/3 |
| out-of-scope | 2/3 | — | 3/3 | 2/3 | 2/3 | 2/3 |
| remote-work | 2/3 | 2/3 | 3/3 | 3/3 | 2/3 | 2/3 |
| vacation-policy | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 | 3/3 |