System Maturity Assessment — A Systematic Framework from Process Approach to Organizational Quality Capability Evaluation

Quality Management System (QMS) maturity assessment is a core tool for organizations to transition from "compliance-oriented" to "excellence-oriented." Unlike traditional compliance audits, maturity assessment not only focuses on whether the system meets the requirements of standard clauses but also emphasizes the effectiveness, suitability, and capability for continual improvement of the system, transforming the QMS from a static documentation system into a dynamic competitiveness engine.

1. Core Concepts of Maturity Assessment

Maturity assessment originates from the idea of the Capability Maturity Model (CMM). In the late 1980s, the Software Engineering Institute at Carnegie Mellon University first proposed the Software Process Capability Maturity Model, dividing software development processes into five levels: Initial, Repeatable, Defined, Managed, and Optimized. This hierarchical and progressive concept has since been widely applied in various fields such as project management, product development, and supply chain management. The QMS maturity assessment is a localized practice of this concept in the quality domain.

Unlike the compliance audits based on ISO 9001 standard clauses, maturity assessment focuses on the quantitative description of the actual depth of system operation. An organization may fully meet all the "shall" clauses of ISO 9001, but its system maturity may only be at the "Defined" level—where documents are comprehensive but execution remains on paper. Maturity assessment uses multi-dimensional behavior-anchored scoring to help enterprises objectively understand their current stage and find specific paths to the next level.

The unique value of QMS maturity assessment lies in three aspects: First, it transforms the abstract effectiveness of the system into measurable and comparable level indicators; second, it provides organizations with a clear improvement roadmap, where each maturity level corresponds to specific capability characteristics and key behaviors; third, it breaks down departmental silos, directly linking the quality system with business performance, allowing senior management to see the real contribution of the QMS to business goals.

2. Five Levels of Maturity Assessment

Referring to mainstream maturity assessment frameworks both domestically and internationally (including ANMB/T 9003-2021 "Evaluation of Organizational Quality Management System Maturity"), we divide the QMS maturity into five levels. Understanding the typical characteristics of each level is the foundation for conducting the assessment.

2.1 Initial Level (Level 1)

Organizations at the Initial Level have a basic framework for their QMS, but operations heavily rely on individual experience and have not yet formed stable process capabilities. Typical manifestations include: incomplete or inconsistent process definitions, a documentation system oriented towards "passing audits," and a focus on firefighting rather than systematic prevention in problem handling. Management attention to the QMS is limited to maintaining the validity of certificates. At this stage, process outcomes are highly variable, quality costs are high, and over 60% of quality issues are identified through post-inspection.

2.2 Managed Level (Level 2)

Organizations that have reached the Managed Level have identified, defined, and controlled key processes. They have established a basic process documentation system, clearly defining process inputs, outputs, resource requirements, and responsible departments. Process performance begins to be measured and monitored, and quality issues can be corrected according to established procedures, with corrective actions forming a preliminary closed loop. Typical characteristics include: the use of turtle diagrams or similar process identification tools, measurable performance indicators for key processes, and management reviews conducted as planned but with limited depth. At this stage, organizations have transitioned from "not knowing what processes are" to "knowing how to manage processes."

2.3 Defined Level (Level 3)

The Defined Level is the actual stage where most organizations certified to IATF 16949 or ISO 9001 are situated. At this level, the interfaces between processes are clearly defined, and cross-functional process collaboration becomes routine. Process documents not only specify what to do but also explain why and how to do it better. Lean tools such as standardized work, layered audits, and continual improvement are integrated into the daily operations of the system. A complete internal audit mechanism is established, involving participation from all departments, not just the quality department, in process method audits. Management reviews begin to focus on process effectiveness and resource suitability, rather than merely repeating KPI data.

2.4 Quantitatively Managed Level (Level 4)

Organizations at the Quantitatively Managed Level are characterized by data and statistical analysis-driven management decisions. Process variations are quantitatively monitored, and Statistical Process Control (SPC) techniques are widely applied to key process parameters and product characteristics. The organization can use tools such as process capability indices (Cpk/Ppk) and Measurement System Analysis (MSA) to regularly assess process stability and capability. Quality objectives are broken down from company-level strategic goals to workstation-level process indicators, and the achievement of these objectives is displayed visually. More importantly, management uses data trends for forward-looking decisions rather than lagging post-event responses. At this stage, organizations evolve from "how well they perform" to "how stable and predictable their performance is."

2.5 Optimized Level (Level 5)

The Optimized Level is the highest level of QMS maturity. Organizations at this stage not only operate their QMS efficiently but also possess self-optimization capabilities—the system can proactively identify improvement opportunities and continuously evolve. The organizational culture transcends "compliance with processes" to "continuous innovation," where employees are not just executors of processes but also drivers of process optimization. Knowledge management becomes a core competency, with best practices systematically replicated and promoted throughout the organization. Quality tools evolve from passive post-event identification to active prevention and prediction. For example, organizations can use advanced data analysis techniques to predict potential failure modes and take preventive measures before defects occur. At this stage, the QMS is no longer a cost center but a core engine for value creation.

3. Implementation Methods for Maturity Assessment

The implementation of maturity assessment requires a systematic methodology, not just a simple checklist. The following five steps form a mature evaluation implementation framework.

3.1 Scope Definition and Evaluation Preparation

Before the evaluation begins, the scope and depth of the assessment must be clearly defined. Is it a comprehensive evaluation covering the entire organization, or a focused evaluation targeting specific processes or business units? What is the purpose of the evaluation—benchmarking certification standards, driving improvements, or meeting customer requirements? After determining the scope, an evaluation team should be formed. Evaluators should have the capability to conduct process method audits, be familiar with the scoring criteria for maturity assessment, and understand the basic business logic of the processes being evaluated. The preparation stage also includes collecting preliminary information: process performance data, findings from previous audits, trends in customer complaints, etc., to provide background references for on-site evaluations.

3.2 Process Evaluation and Evidence Collection

Maturity assessment is process-based. Evaluators assess each process according to the process method, collecting objective evidence from four dimensions: process planning, process execution, process monitoring, and process improvement. Evidence sources include: process documentation records, performance data trends, employee interviews, and on-site observations. Unlike compliance audits, maturity assessment particularly focuses on the sufficiency and consistency of evidence—not just checking a few records but cross-verifying the actual process operation status through multiple evidence chains.

3.3 Scoring and Level Determination

Each process is independently scored according to the five-level maturity model. Scoring uses a behavior-anchored method, with specific behavior descriptions for each level. Evaluators match the observed actual behaviors with the level descriptions. The scoring logic is as follows: whether the process is defined and executed consistently (basis for Level 1→2 judgment); whether the process is standardized and cross-functionally collaborative (basis for Level 2→3 judgment); whether process performance is quantitatively managed and statistically supported (basis for Level 3→4 judgment); and whether the process has self-optimization and continuous innovation capabilities (basis for Level 4→5 judgment). The overall maturity level of the organization is determined by the weighted or lowest score of each process, depending on the evaluation purpose.

3.4 Result Analysis and Improvement Path

The ultimate goal of the evaluation is not just to assign a level label but to identify improvement opportunities and develop action paths. The evaluation report should include three key outputs: a maturity level profile of the organization, a list of strengths and weaknesses for each process, and recommendations for improvement paths to the next level. Improvement path recommendations should be specific, actionable, and prioritize milestones. For example, if an organization is currently at the Managed Level and aims to enter the Defined Level, the improvement path might include: establishing a cross-functional process interface management mechanism, introducing a layered audit system, and launching the promotion of standardized work.

3.5 Re-evaluation and Evolution Tracking

Maturity assessment is not a one-time activity. Organizations should establish a regular re-evaluation mechanism (typically every 12-18 months) to track the trend of maturity level changes. The key to re-evaluation is not the mechanical increase in scores but the verification of whether the organization has truly formed a continuous improvement loop. It is recommended to link maturity assessment with management reviews and strategic planning, making QMS maturity indicators a part of organizational performance management.

4. Typical Models and Standards for Maturity Assessment

Several mature maturity assessment models have been developed both domestically and internationally, and organizations can choose appropriate reference frameworks based on their industry characteristics and business needs.

ISO 9004:2018 "Pursuing Organizational Success — A Quality Management Approach" provides an evaluation framework for excellence performance, emphasizing the pursuit of continuous success on the basis of meeting ISO 9001 requirements. The CMMI V2.0 model divides maturity into five levels and is widely used in R&D and engineering fields, with its evaluation methods highly compatible with QMS maturity assessment. The "Manufacturing Process Audit" (VDA 6.3) implicitly embedded in the IATF 16949 certification system also reflects the idea of process maturity assessment—scoring all elements from process input to output. Domestically, the China Association for Standardization's T/CAS XXX "Guidelines for the Evaluation of Organizational Quality Management System Maturity" provides localized implementation guidance.

The choice of model is not critical; what is important is that organizations establish an evaluation framework suitable for their size, industry characteristics, and development stage. Small and medium-sized enterprises (SMEs) do not need to pursue comprehensive coverage of all five levels; the improvement path from Level 1 to Level 2 also has significant practical value.

5. Common Pitfalls in Maturity Assessment

In practice, maturity assessment can easily fall into several pitfalls that need to be addressed.

The first pitfall is equating maturity assessment with "advanced audits." There are fundamental differences in purpose, method, and output between maturity assessment and traditional audits. Traditional audits conclude with "compliant/non-compliant," while maturity assessment concludes with "current level + improvement direction." The former is a compliance check, and the latter is a capability diagnosis.

The second pitfall is the pursuit of rapid score improvement. Maturity improvement requires systematic organizational change and continuous cultural development and cannot be achieved through a single concentrated rectification. The consequence of deliberately pursuing short-term score improvement is often a return to the old path of "surface compliance," which undermines the credibility of the assessment.

The third pitfall is neglecting cultural factors. If the scoring dimensions of maturity assessment focus only on processes and metrics while ignoring soft elements such as employee engagement, leadership commitment, and organizational learning, the evaluation results will seriously deviate from reality. An organization with the most efficient system operation will have formed a consensus of "quality governance" at the cultural level.

The fourth pitfall is shelving the evaluation results. If the maturity assessment report is only used for management reporting or customer presentations and not converted into specific improvement action plans, the investment in the assessment is wasted. Improvement paths must be integrated into the organization's operational plans and performance management systems to ensure resources, responsible persons, and tracking.

Maturity assessment transforms the system from compliance to excellence

Knowledge Number: 2.2.3

Version: v20260708

Author: Excellence Quality Think Tank Excellence Quality Think Tank is dedicated to providing systematic professional knowledge, methodologies, and practical tools for quality management practitioners, helping enterprises continuously enhance their quality capabilities.