About this site 한국어

Unofficial explanatory translation of the Korean AI-Ready Data (AIRD) draft standard. The Korean text prevails.

Concepts and judgment

Judgment procedure

Type · ExplanationReading time · about 5 minAll readers

ContentsContents
  1. Diagnostic Maturity decision table
  2. Evaluation coverage
  3. Measurement without an operating guideline
  4. Reach by data type
  5. Tier judgment steps
  6. Quality-Ready transition conditions
  7. Tier labels

The diagnostic tool judges Diagnostic Maturity and the quality tier by applying, in turn, a decision table and the threshold profile of an operating guideline.

The diagnostic tool does the calculation. The judgment criteria are set by an operating guideline that is separate from the standard. Data providers do not perform this procedure themselves.

Apply from the top — stop at the first row that is met1Diagnosis status is SCHEMA_ONLY or FILE_BROKENNot judgedYesNo2All applicable required formal indicators APPLIEDDM-2YesNo3All applicable MMIs APPLIED and coverage at or above the lower boundDM-1YesNo4All applicable MMIs APPLIEDDM-0YesNo5All other casesDM-0 not metNo operating guideline: D5-03 measured provisionally with example patterns — stops at row 4 (DM-0)
Order of applying the Diagnostic Maturity decision table. Apply it from the top; it ends at the first row that is met. DM-1 is judged not by the number of measured indicators but by whether evaluation coverage is at or above the lower bound set by the operating guideline. Without an operating guideline, D5-03 (Statistical plausibility) is measured provisionally with example patterns, so the data reaches row 4 (DM-0).

Diagnostic Maturity decision table

Diagnostic Maturity (DM) shows how far the required indicators have been measured. The diagnostic tool applies the table below from the top and ends the judgment at the first row that is met. [Part 2 Annex B.5 Table B.4]

OrderConditionJudgment
1Diagnosis status exception: SCHEMA_ONLY (empty file) or FILE_BROKEN (corrupted file)Not judged
2All applicable required formal indicators are APPLIEDDM-2
3All applicable minimum measurable indicators (MMI) are APPLIED · evaluation coverage is at or above the operating guideline’s lower boundDM-1
4All applicable MMIs are APPLIEDDM-0
5All other casesDM-0 not met
  • There are four MMIs: D5-03 · D6-01 · D7-01 · D7-02. Only those that apply to the data type are counted.
  • If any required formal indicator is only partially measured (PARTIALLY_APPLIED), DM-2 is not met.

Evaluation coverage

Evaluation coverage is a value from 0 to 1 used to judge DM-1. [Part 2 Annex A.3 · B.5]

Evaluation coverage = Σ statusFactor(applicable required formal indicators) / n(required formal indicators excluding NOT_APPLICABLE)

  • Numerator: the sum of statusFactor over the applicable required formal indicators. statusFactor is a value fixed for each applicability status of an indicator (see the indicator applicability table in Status and judgment values).
  • Denominator: the number of required formal indicators, excluding NOT_APPLICABLE.
  • Lower bound: set by the threshold profile of the operating guideline.

Example STRUCT (tabular) data has 13 required formal indicators. If one of them is NOT_APPLICABLE, the denominator is 12. If the statusFactor sum is 7 (for example, 7 APPLIED and the rest PRECONDITION_UNMET), evaluation coverage is 7/12 ≈ 0.58. Whether DM-1 is met is judged by comparing this value with the operating guideline’s lower bound.

Measurement without an operating guideline

Measurement works even without an operating guideline. D5-03 (Statistical plausibility) takes its dummy-value patterns from the threshold profile of the operating guideline. Without an operating guideline, the diagnostic tool measures D5-03 provisionally with the example patterns in Part 2 Appendix I and records the evaluation status as PROVISIONAL. [Part 2 5.1 · Annex A.4.1 · Appendix I]

D6-01 (Uniqueness) has no precondition. If there is no identifying column, the diagnostic tool counts fully identical records across the combination of all columns. All four MMIs (D5-03 · D6-01 · D7-01 · D7-02) can therefore be measured from the file alone, and DM-0 in row 4 of the decision table is met.

  • DM-1 can only be judged with the operating guideline’s lower bound for evaluation coverage. Without an operating guideline, DM-1 is not judged.
  • The status of the example threshold profile (Appendix I) is EXAMPLE. The example threshold profile is used for provisional calculation and tool development, not for tier judgment.
  • The quality tier is judged only when an operating guideline is applied. The operating guideline provided with the standard is to be published when the standard is established (expected December 2026). Organizations, institutions and domains can build their own operating guidelines and judge with them. [Part 1 7.1]

Reach by data type

The table below shows the Diagnostic Maturity each data type reaches without an operating guideline. Without an operating guideline, the quality tier is “Not judged: no operating guideline applied” regardless of Diagnostic Maturity.

Data typeRequired formal indicatorsDiagnostic Maturity without an operating guidelineReason
STRUCT tabular13DM-0 (provisional)D5-03 measured provisionally with example patterns
TSERIES time series13DM-0 (provisional)D5-03 measured provisionally with example patterns
TEXT documents5DM-2 (when all 5 required formal indicators are measured)If all 5 required formal indicators are APPLIED, row 2 of the decision table is met
PT instruction–response pairs8DM-0D3-02 (Label accuracy) needs expert review results
IMAGE images3DM-0D3-02 (Label accuracy) needs expert review results

Without a lower bound for evaluation coverage, DM-1 is not judged for any data type.

Tier judgment steps

Order in which a tier is determined

The diagnostic tool first checks two preconditions. If they are not met, it does not judge a tier and records the reason.

PreconditionRecord when not met
Operating guideline appliedNot judged: no operating guideline applied
Diagnostic Maturity DM-2Not judged: below DM-2

When both preconditions are met, the diagnostic tool judges the tier in the order below. [Part 2 6 · 7]

  1. Find the minimum dimension score. Input: the seven dimension scores in the diagnostic report. Output: the lowest dimension score. [Part 2 6.2]
  2. Set the candidate tier. Input: the minimum dimension score · the tier bands of the threshold profile. Output: the tier of the band that contains the minimum dimension score (candidate tier).
  3. Check the required pass line per dimension. Input: the seven dimension scores · the per-dimension required pass lines of the threshold profile. Output: the list of dimensions below their pass line.
  4. Demotion. If any dimension falls short, the candidate tier is lowered by one tier. Output: the demoted tier and the reason for demotion. [Part 2 7.3]
  5. Record the final tier. Output: the final tier (for example, Gold (Tier 3, STRUCT)) and the identifier · version of the operating guideline applied.
  • Averages (simple or weighted) are not used in tier judgment.
  • Tier bands and per-dimension required pass lines are set by the threshold profile of the operating guideline. The items of a threshold profile are listed in Building an operating guideline.
  • Tier names: Tier 0 Unqualified · Tier 1 Bronze · Tier 2 Silver · Tier 3 Gold · Tier 4 Platinum.

Quality-Ready transition conditions

At decision gate G2, data transitions to the Quality-Ready state when all of the conditions below are met. [Part 2 7.5]

  • Diagnostic Maturity DM-2
  • Quality tier Tier 1 or higher
  • Threshold profile of an operating guideline applied
  • Transition judged at decision gate G2

States and decision gates are defined in Key concepts.

Tier labels

KindFormatExample
Quality tier<tier name> (Tier N, <data type>[, additional status])Gold (Tier 3, STRUCT)
Purpose tierP-Tier N (<use purpose type>)P-Tier 2 (KG)
  • Never use a tier name on its own. Always state the data type with it. [Part 1 Annex A]
  • Do not drop the P- prefix from a purpose tier.
  • Diagnostic Maturity (DM) is not part of the tier label. It is recorded as a separate item in the diagnostic report.
  • A tier always carries the identifier · version of the operating guideline applied.
Last updated · 2026-10-07Report an error