Public test / 13 October 2026
AI answers, checked against GitLab's own.
I hid GitLab's published CAIQ answers and tested an AI workflow using only its public handbook.
GitLab's published answer
174 matched · 2 differed · 60 abstained
The always-Yes baseline matched 225 of 236 labels. The workflow correctly answered 0 of 11 No/N/A cases. Both wrong answers passed the quote check unflagged. A genuine quote does not prove the answer is right. The expert signs off every answer. This is a public-document test, not a finding about GitLab's security or a promised accuracy rate.
How the routing figures were counted
176 of 236 answered. 63 of 236 sent for expert review. The 47 questions used for tuning are excluded. The review rule changed after the held-out run; these routing figures re-score the same answers.
