NILEAGI-SUB · Available

SUB-MCQ EDUCATION

2,569 expert-reviewed Swahili multiple-choice items from the Swahili-subject curriculum (Standard 3-7 and Form 2-4). First public release under NILEAGI-SUB; later sectors follow the same protocol.

2,569

Validated items

8

Grade bands

22.4%

Chance baseline

About this release

A model can sound fluent in Swahili and still fail on the vocabulary and reasoning in a Form 4 exam. This set gives a grade-stratified school signal for compact open models, scored with exact-match multiple choice under a controlled protocol. Featured in the Cohere Labs Open Science Community.

Items by grade

Grade bandItemsShare
Standard 3662.6%
Standard 41164.5%
Standard 527410.7%
Standard 665125.3%
Standard 751720.1%
Form 239915.5%
Form 31254.9%
Form 442116.4%
Total2,569100%

How this data is built

01

Source

Curriculum-aligned Swahili language items (grammar, comprehension, vocabulary, literature), not maths or science taught in Swahili.

02

Validate

Expert review, format checks, and grade-band assignment produce a clean multiple-choice set ready for controlled evaluation.

03

Evaluate

Open models run under identical prompts and deterministic decoding; accuracy is exact-match against the gold letter.

04

Release

Technical report, public story, dataset access paths, and benchmark pages so others can reproduce and extend the work.

Access