Open data

Bayanat Labs Open: Free Arabic Dataset Resources

Every free Arabic dataset, tool and benchmark published by Bayanat Labs, with licence, DOI and citation (updated 19 October 2026). اقرأ بالعربية ←

In the catalogue

17open releases
5datasets
3benchmarks
6tools
1report
2guides
3with a Zenodo DOI

Releases

Dataset · Live

Bayanat Labs Arabic AI Model Tracker

89 Arabic and Arabic-capable AI model releases from 29 labs: date, sizes, Arabic varieties named, lab-reported scores, licence and weights status.

CC BY 4.0 (register, exports, charts and documentation); Apache-2.0 (crawler and build code); quotations stay with their authors · Updated
Tool · Live

Bayanat Labs Dataset Licence Compatibility Checker

Check whether dataset sources can be merged, trained on or redistributed, with the obligations, release licence options and the clause behind each step.

Apache-2.0 (code and web app); CC BY 4.0 (rules, test cases, schemas and documentation); quotations from licences and terms stay under their owners' terms · Updated
Dataset · Live

Bayanat Labs Arabic Document Atlas

200,286 unique document images with machine OCR, approximate word guides and source evidence, plus separate community text and PDF/reference pairs.

Component-specific rights: institution-asserted public-domain ACO images; CC BY 4.0 annotations/docs; CC BY-SA 4.0 community text and reference pairs; Apache-2.0 code · Updated
Guide · Live

Bayanat Labs Arabic Annotation Guidelines Template

Free Arabic annotation guidelines template under CC BY 4.0: sections for dialect, diacritics, Arabizi, examples and pilots. Licence, citation and reuse terms.

CC BY 4.0 · Updated
Dataset · Live

Bayanat Labs Arabic ASR Channel Pairs

Free Arabic speech test set: FLEURS recordings, clean and under simulated telephone, codec and room conditions, in aligned pairs, with Whisper WER.

CC BY 4.0 (audio, metadata and measurements); CC BY-SA 4.0 (transcript text); CC0 1.0 (conditions file and impulse responses); Apache-2.0 (renderer code) · Updated
Tool · Beta

Bayanat Labs Arabic Text Normalizer (arabic-normalize)

Release record for arabic-normalize: named, versioned Arabic normalisation policies in Python and JavaScript, with conformance fixtures. Apache-2.0 code.

Apache-2.0 (code); CC BY 4.0 (conformance fixtures) · Updated
Tool · Live

Bayanat Labs Arabic PII Pack for Presidio

Release record for arabic-pii-pack: Presidio recognisers and redaction for Gulf and Egyptian IDs, Arab IBANs and phones, plates and Arabic names.

Apache-2.0 (code and in-browser redactor); CC BY 4.0 (evaluation set, results and documentation) · Updated
Benchmark · Live

Bayanat Labs Arabic Token-Tax Index

How many more tokens Arabic takes than English: LLM tokenisers measured on UN parallel text, with bootstrap intervals and the cost of a page.

CC BY 4.0 (index data and documentation); Apache-2.0 (harness code and leaderboard); UN sentence pairs under the United Nations Parallel Corpus disclaimer · Updated
Benchmark · Live

Bayanat Labs Arabic Unicode Conformance Suite

Release record for the Arabic Unicode Conformance Suite: test cases with exact expected outputs under six named normalisation policies, and a runner.

CC BY 4.0 (cases, policy specifications, documentation and reports); Apache-2.0 (code) · Updated
Tool · Live

Bayanat Labs ArabicWER: Arabic WER and CER Scorer

Release record for ArabicWER: Arabic WER and CER under six named, versioned normalisation policies, with conformance fixtures and a FLEURS case study.

Apache-2.0 (code); CC BY 4.0 (policies, specification, fixtures and case-study outputs) · Updated
Guide · Live

Bayanat Labs Contributor Consent Templates

Free consent form, contributor agreement, privacy notice and more for collecting open Arabic data under the Saudi PDPL, in English and Arabic. CC BY 4.0.

CC BY 4.0 · Updated
Tool · Beta

Bayanat Labs Dataset Template and Release Kit

Release record for the Bayanat Labs dataset template: a copier template, a bilingual dataset-card standard and a release kit with a card linter and gates.

Apache-2.0 (code); CC BY 4.0 (standard and docs) · Updated
Dataset · Live

Bayanat Labs GCC Format Validators and Arabic ITN/TN Test Pairs

Release record: Arabic spoken and written test pairs for ITN and TN, with Gulf format tables and validators for IDs, IBANs, phones, plates and Hijri dates.

CC BY 4.0 (test pairs and tables); CC0 1.0 (format facts); Apache-2.0 (phone plans and code) · Updated
Report · Live

Bayanat Labs Open-Programme Policy and Operating Manual

Release record for the Bayanat Labs open policies: the open-programme policy, the gated operating manual and the bl-score tool, in English and Arabic.

CC BY 4.0 (text); Apache-2.0 (code) · Updated
Tool · Beta

Bayanat Labs Arabic Agent Reliability Lab

Arabic Agent Reliability Lab release record: a local harness that grades Arabic AI agents by tool calls and final state. Apache-2.0 code, CC BY 4.0 data.

Apache-2.0 (code); CC BY 4.0 (open scenarios and receipts) · Updated
Dataset · Live

Bayanat Labs Arabic Retrieval Starter Kit

Download the free Arabic Retrieval Starter Kit v0.1: a synthetic Arabic and English RAG evaluation fixture under CC BY 4.0, with qrels, DOI and citation.

CC BY 4.0 · Updated
Benchmark · Results only

Bayanat Labs LabelBench

LabelBench release record: aggregate Arabic labeling results (CC BY 4.0), Apache-2.0 code on GitHub and PyPI, Zenodo DOI, citation and licences.

CC BY 4.0 (results, charts, report); Apache-2.0 (code) · Updated

All releases at a glance

ReleaseTypeLicenceSizeVersionDOIUpdated
Arabic AI Model TrackerDatasetCC BY 4.089 model releases recordedv0.1.0None
Dataset Licence Compatibility CheckerToolApache-2.033 licences and terms encodedv0.1.0None
Arabic Document AtlasDatasetComponent-specific rights200286 unique decoded document images across image componentsv0.3.0None
Arabic Annotation Guidelines TemplateGuideCC BY 4.012 copy-ready template sectionsUnversionedNone
Arabic ASR Channel PairsDatasetCC BY 4.0500 clean FLEURS recordings (parents)v0.1.0None
Arabic Text Normalizer (arabic-normalize)ToolApache-2.080 conformance fixturesv0.1.0None
Arabic PII Pack for Presidio (arabic-pii-pack)ToolApache-2.01000 synthetic test sentences (every value generated)v0.1.0None
Arabic Token-Tax IndexBenchmarkCC BY 4.012 tokenisers measuredv0.1.0None
Arabic Unicode Conformance SuiteBenchmarkCC BY 4.0300 test casesv0.1.0None
ArabicWER (arabicwer)ToolApache-2.0120 conformance fixtures in the dev splitv0.1.0None
Contributor consent templatesGuideCC BY 4.0—v1.0None
Dataset template and release kitToolApache-2.0—v0.1.0None
GCC Format Validators and Arabic ITN/TN Test PairsDatasetCC BY 4.02000 ITN/TN test pairsv0.1.0None
Open-programme policy and operating manualReportCC BY 4.013 stages in the operating manualv1.0.1None
Arabic Agent Reliability LabToolApache-2.021 synthetic workflow familiesv0.2.010.5281/zenodo.23355782
Arabic Retrieval Starter KitDatasetCC BY 4.012 passages in Arabic and Englishv0.110.5281/zenodo.23355780
LabelBenchBenchmarkCC BY 4.012 model-task resultsv0.110.5281/zenodo.23355784

Why we publish open Arabic data

Bayanat Labs is a Riyadh-based Arabic data company. We build data, never models, so we never compete with the teams that use our work. We publish small open releases, benchmarks, tools and guides so anyone can test Arabic AI work in the open, check our methods and cite the result.

Bayanat Labs is not affiliated with bayanat.ae (the UAE open-data portal), the former Bayanat AI (now Space42), or the ARBML bayanat library.

Recent changes

Arabic AI Model Tracker v0.1.0Register, exports, charts, Atom feed and latest.json on Hugging Face; crawler, inclusion rules and export builder on GitHub; the filterable release table on this site.
Dataset Licence Compatibility Checker v0.1.0Rules engine, Python library, command line, GitHub Action, rules and verdict test cases on GitHub; the web app in English and Arabic on Hugging Face Spaces.
Arabic Document Atlas v0.3.0Expanded frozen training release: 200,286-image union and 679 ACO source books with published images, with complete/partial/error coverage reported separately. Machine word annotations remain distinct from reference text; three exact-pixel duplicate occurrences supply lineage only. Reference-pair and community-text cohorts are unchanged.
Arabic Document Atlas v0.2.0Expanded frozen training release with additional ACO page images, machine word annotations, explicit source-book coverage, and a separate duplicate-lineage configuration. Reference-pair and community-text cohorts are unchanged.
Arabic Annotation Guidelines TemplateLicence stated: CC BY 4.0.
Arabic ASR Channel Pairs v0.1.0Clean and rendered audio, metadata, measurements and Whisper word error rate tables on Hugging Face; the renderer, conditions file and impulse responses on GitHub.
Arabic Document Atlas v0.1.0Frozen training release: unique image union, ACO image/OCR records, separately licensed PDF/reference pairs, text-only Wikisource records and hash-bound source evidence.
Arabic Text Normalizer (arabic-normalize) v0.1.0Pilot code (v0.1.0, not released yet) on GitHub, the in-browser tool on Hugging Face Spaces and the conformance fixtures on Hugging Face.

Work on Arabic data with us

Native Arabic speakers, linguists and domain professionals can join the Talent Network for remote, paid-per-task Arabic data work. It is free to apply.

Join the Talent Network →

Need production-grade, rights-cleared data?

We publish synthetic fixtures, open benchmarks, results, code and guides for free. Data at scale is licensed or built to order: ready-to-license Arabic speech and text datasets with commercial AI-use rights written into the agreement, and custom collection, annotation and evaluation.