Criterion 7: Continuous Improvement Under NBA Accreditation: Closing the Loop in Outcome-Based Engineering Education Through Evidence, Evaluation and Action
Criterion 7: Continuous Improvement Under NBA Accreditation |
Closing the Loop in Outcome-Based Engineering Education Through Evidence, Evaluation and Action
By Prof. (Dr.) Dalgobind Mahto
1. Introduction
Continuous improvement is one of the most important principles of quality assurance in engineering education. An engineering programme cannot demonstrate quality merely by following a prescribed curriculum, conducting examinations, maintaining laboratories or achieving satisfactory student results. It must also demonstrate that it systematically evaluates its performance, identifies weaknesses, implements corrective measures and verifies whether those measures have produced improvement.
The National Board of Accreditation (NBA), India, emphasizes this process through its accreditation framework for undergraduate engineering programmes. Continuous improvement connects the evidence generated through course outcome (CO) assessment, programme outcome (PO) attainment, student performance, academic audits, placement outcomes and stakeholder feedback with measurable actions to enhance programme quality.
The central principle is simple: measure performance, identify gaps, implement improvements and verify their effectiveness.
An institution should not treat continuous improvement as a document-preparation exercise undertaken immediately before an accreditation visit. It should be an ongoing academic and administrative practice embedded in the programme's annual quality cycle.
An important clarification about criterion numbering
Under the earlier NBA Undergraduate Engineering Tier-II first-time accreditation framework, Criterion 7: Continuous Improvement carries 50 marks. In the January 2025 Tier-II SAR format, the criteria were reorganized: Facilities and Technical Support became Criterion 7, while Continuous Improvement became Criterion 8. The discussion below explains Continuous Improvement using the earlier Criterion 7 framework, which is the basis for the 50-mark distribution described here. Institutions must use the criterion number and requirements specified in the SAR applicable to their accreditation cycle.
2. Objectives of Continuous Improvement
The principal objectives are to ensure that an engineering programme:
Evaluates the attainment of all relevant POs and Program Specific Outcomes (PSOs).
Identifies gaps between expected and actual student learning outcomes.
Develops and implements evidence-based corrective and preventive actions.
Conducts academic audits and acts on their findings.
Improves placement outcomes, higher education progression and entrepreneurship.
Enhances the quality of students admitted to the programme.
Uses feedback from students, faculty, alumni, employers and other stakeholders.
Maintains evidence that improvements are implemented and evaluated over time.
Continuous improvement should produce demonstrable changes in teaching, learning, assessment, curriculum delivery, student support and graduate outcomes.
3. Criterion-wise distribution of marks
The earlier Tier-II framework allocates 50 marks across four sub-criteria.
Sub-criterion | Area of assessment | Maximum marks |
|---|---|---|
7.1 | Actions based on evaluation of POs and PSOs | 20 |
7.2 | Academic audit and actions taken during the assessment period | 10 |
7.3 | Improvement in placement, higher studies and entrepreneurship | 10 |
7.4 | Improvement in the quality of students admitted to the programme | 10 |
Total | 50 |
The evaluation is not simply about whether an institution has prepared reports. It examines whether the programme uses evidence to identify weaknesses, implement relevant actions and demonstrate improvement.
4. Sub-criterion 7.1: Actions Based on Evaluation of POs and PSOs — 20 Marks
This is the central component of continuous improvement. It evaluates whether the programme uses the results of PO and PSO attainment to identify weaknesses and implement corrective measures.
The earlier Tier-II evaluation guideline divides the 20 marks into three components: documentation of attainment levels (5 marks), identification of gaps or shortfalls (5 marks), and action planning and implementation (10 marks).
4.1 What institutions must demonstrate
The programme should demonstrate a systematic process for:
Calculating PO and PSO attainment using defined assessment methods.
Comparing attainment with predetermined targets.
Identifying outcomes that have not achieved their targets.
Investigating the underlying causes of underperformance.
Preparing corrective action plans with responsibilities and timelines.
Implementing the planned actions.
Evaluating the results in subsequent assessment cycles.
The objective is not to show that every PO and PSO always achieves its target. Rather, the programme must demonstrate that gaps are identified honestly and addressed systematically.
4.2 Documents to be prepared
CO, PO and PSO attainment reports for the assessment years.
Programme articulation matrix and CO–PO/PSO mapping.
Direct and indirect assessment results, with calculation methodology.
Target-setting policy and attainment thresholds.
Comparative attainment analysis for each PO and PSO.
Gap analysis and root-cause analysis reports.
Approved action plans, meeting minutes and implementation records.
Evidence of subsequent assessment and effectiveness review.
4.3 Illustrative example
Suppose an engineering programme identifies that PO3, relating to design and development of solutions, is below its expected attainment level.
Improvement stage | Illustrative action |
|---|---|
Finding | PO3 attainment is below the programme's target |
Gap analysis | Students have limited opportunities for open-ended design and prototype testing |
Planned action | Introduce design challenges, project reviews and prototyping activities |
Implementation | Faculty redesign selected assignments and provide access to project facilities |
Follow-up assessment | Evaluate design rubrics, project performance and PO3 attainment in the next cycle |
Effectiveness review | Compare the new results with the baseline and decide whether further action is needed |
This example illustrates the required logic. Institutions should use their actual attainment data and real implementation evidence rather than copying illustrative results into their SAR.
5. Sub-criterion 7.2: Academic Audit and Actions Taken — 10 Marks
Academic audits provide a structured mechanism for reviewing the quality of academic delivery, assessment and programme operations.
An effective audit examines whether academic activities are conducted as planned, learning outcomes are assessed appropriately, academic records are maintained and identified deficiencies are addressed.
5.1 Major components of an academic audit
Review of course files, lesson plans and syllabus coverage.
Verification of CO statements and assessment methods.
Review of question papers and assessment practices.
Analysis of student attendance, performance and learning gaps.
Examination of laboratory work, projects and practical assessments.
Verification of CO attainment and PO/PSO mapping.
Review of student feedback and stakeholder suggestions.
Follow-up on previous audit observations.
5.2 Documents to be prepared
Document | What it demonstrates |
|---|---|
Academic audit policy | Defined purpose, scope and responsibilities |
Audit schedule and criteria | Planned and systematic review |
Audit reports and observations | Findings supported by evidence |
Corrective action reports | Responses to identified deficiencies |
Action-taken reports | Implementation of recommendations |
Follow-up audit results | Verification of effectiveness |
Departmental meeting minutes | Review, accountability and decisions |
5.3 How evaluators assess this area
Evaluators examine the audit mechanism, its frequency, the quality of findings, the action plans arising from those findings, and evidence that actions were implemented and evaluated. These are specifically identified in the earlier Tier-II evaluation guidelines.
A department should not limit academic auditing to collecting faculty signatures or checking whether files are complete. The audit should improve academic practice.
Best practice: Maintain an observation-to-closure register showing each finding, its priority, the responsible person, the corrective action, the completion date and the evidence used to verify closure.
6. Sub-criterion 7.3: Improvement in Placement, Higher Studies and Entrepreneurship — 10 Marks
This sub-criterion evaluates whether the programme demonstrates improvement in graduate progression and career outcomes.
The earlier Tier-II guideline allocates:
Placement improvement: 5 marks
Improvement in higher studies: 3 marks
Improvement in entrepreneurship: 2 marks.
SAR Tier – II (UG Engineering)+1
6.1 Improvement in placements
Institutions should examine more than the total number of offers. Relevant indicators may include:
Number and proportion of eligible students placed.
Number of unique students placed, distinguishing them from total offers.
Quality and relevance of employment.
Recruitment by core engineering and relevant industry sectors.
Salary or compensation trends, using consistent definitions.
Diversity of recruiters and job roles.
Internship-to-employment progression, where applicable.
Documents: Placement records, verified offer letters, student-wise placement data, employer details, eligible-student lists, salary records and year-wise analysis.
6.2 Improvement in higher studies
Relevant evidence may include:
Number of graduates admitted to postgraduate programmes.
Admissions to recognized universities and reputed institutions.
Relevant national or international qualifying examinations.
Year-wise progression to higher education.
Verified admission or enrolment records.
Documents: Student-wise higher-study progression lists, admission letters, enrolment evidence, qualifying examination records where relevant, and comparative analysis.
6.3 Improvement in entrepreneurship
Institutions may track graduates who establish ventures, launch products or services, or develop entrepreneurial activities.
Supporting initiatives can include entrepreneurship cells, incubation centres, innovation challenges, startup mentoring and business-plan development. However, the institution should distinguish genuine entrepreneurial outcomes from participation in entrepreneurship events.
Documents: Verified startup details, founder or student records, registration evidence where available, incubation records, product or service documentation, and year-wise outcome analysis.
6.4 How evaluators assess improvement
The earlier guideline compares the assessment-year data with the designated base year, identified as CAYm3 in the guideline. Institutions should use the prescribed reference year and definitions, not select a convenient baseline.
For example, an institution might compare the placement rate, higher-study progression and number of graduate entrepreneurs across three assessment years. The comparison should account for eligible student numbers and clearly explain changes in definitions or data coverage.
7. Sub-criterion 7.4: Improvement in the Quality of Students Admitted — 10 Marks
The quality of incoming students influences their academic readiness, progression and potential to achieve programme outcomes.
The earlier Tier-II framework considers improvement in admission quality through indicators such as entrance examination ranks or scores, Class XII Physics, Chemistry and Mathematics marks, and the academic performance indicators specified for lateral-entry students. The prescribed base year is used for comparative assessment.
7.1 Documents to be prepared
Student-wise admission lists for the assessment years.
Official admission authority guidelines.
Entrance examination ranks or scores, where applicable.
Class XII subject-wise marks and aggregate records.
Lateral-entry admission and qualifying examination records.
Year-wise statistical summaries.
Comparative analysis using consistent definitions and verified data.
7.2 How evaluators assess this sub-criterion
Evaluators examine whether the institution has used authentic admission records, followed the applicable admission rules and demonstrated the trend using comparable data.
Institutions should avoid claiming improvement solely because the total number of admitted students increased. The evidence should relate to the academic indicators specified in the applicable framework.
It is also important to distinguish admission quality from teaching effectiveness. Better entry profiles do not, by themselves, establish that the programme has improved; they must be interpreted alongside student progression and learning outcomes.
8. The Continuous Improvement Cycle: From Evidence to Results
A practical model is the Measure–Analyse–Plan–Implement–Verify–Improve cycle.
1. Measure
Collect reliable data on CO, PO and PSO attainment, academic performance, placement, higher studies, entrepreneurship and admission indicators.
2. Analyse
Compare actual results with targets and historical performance. Identify gaps and investigate root causes.
3. Plan
Define the corrective action, measurable expected result, responsible person, resources and completion date.
4. Implement
Execute the action through revised teaching methods, additional practice, faculty development, curriculum changes or other appropriate interventions.
5. Verify
Assess the results in a subsequent cycle and determine whether the intervention produced the intended improvement.
6. Improve again
Retain effective practices, revise ineffective actions and begin the next improvement cycle.
The process is incomplete if the institution stops at the action plan. Evidence of implementation and subsequent effectiveness is essential to closing the loop.
9. Consolidated Documentation Checklist
The following checklist can be used by the NBA coordinator, Head of Department, programme assessment committee and academic audit team.
NBA readiness checklist
A. PO and PSO attainment
B. Academic audit
C. Graduate progression
D. Admission quality
E. Quality assurance
10. Common Mistakes to Avoid
1. Reporting data without analysis: Tables showing attainment or placements do not explain what the programme learned from the results.
2. Identifying gaps without corrective action: Every significant gap should lead to a documented, proportionate response.
3. Preparing action plans that were never implemented: Planned activities must be supported by implementation evidence.
4. Failing to verify effectiveness: Institutions should examine subsequent results rather than assuming an action was successful.
5. Changing calculation methods without explanation: Attainment methodology and data definitions should be consistent or changes must be clearly documented.
6. Using unsupported claims: Placement, higher-study and entrepreneurship data should be authentic, traceable and appropriately verified.
7. Ignoring negative trends: Honest analysis of underperformance, accompanied by credible action, is more meaningful than presenting only positive results.
8. Treating academic audits as paperwork: An audit should identify opportunities for improvement and ensure follow-up.
9. Using an incorrect base year: The institution must follow the base year and assessment period specified in the applicable NBA guidelines.
10. Confusing activities with outcomes: Conducting a workshop is an activity; demonstrating improved student competence is an outcome.
11. Recommended Institutional Implementation Strategy
A practical institutional strategy should establish clear responsibilities and a predictable review cycle.
Frequency | Recommended activity | Primary responsibility |
|---|---|---|
Every course cycle | Review CO attainment and identify learning gaps | Course coordinator |
Each semester | Review course outcomes, student performance and corrective actions | Programme assessment committee |
Annually | Review PO/PSO attainment, academic audit findings and improvement priorities | Head of Department and programme committee |
Annually | Analyse placement, higher studies, entrepreneurship and admission trends | Department, placement cell and admission office |
Each review cycle | Verify action implementation and effectiveness | Assigned academic or quality committee |
Before SAR submission | Check consistency, traceability and compliance with the applicable manual | NBA coordinator and institutional leadership |
The institution should maintain a central improvement register. Each entry should contain the finding, supporting evidence, root cause, planned action, responsible person, deadline, implementation status and effectiveness result.
12. How Evaluators Determine Whether Improvement Is Genuine
Evaluators are interested in a coherent chain of evidence rather than isolated documents.
Evidence of a problem
What did the data, audit or stakeholder feedback reveal?
Reasoned response
Why was the selected intervention appropriate?
Proof of implementation
What was actually changed, when and by whom?
Evidence of effectiveness
What changed in the subsequent assessment, and what further action is needed?
This chain should be visible across the SAR, supporting records, academic committee minutes and stakeholder interactions. Evaluators may cross-check the information with other criteria and ask faculty or students to explain how improvements were implemented.
13. Conclusion
Continuous improvement is the mechanism through which an engineering programme converts assessment into meaningful educational change. It requires reliable data, honest gap analysis, appropriate interventions, accountable implementation and subsequent verification.
For NBA accreditation, the objective is not to demonstrate that an institution has never had a weakness. It is to demonstrate that the programme can identify its weaknesses, respond effectively and improve its performance over time.
The essential relationship is:
Assessment → Gap Identification → Action Planning → Implementation → Effectiveness Review → Further Improvement
When this cycle becomes part of routine academic governance, accreditation preparation becomes more credible, student learning becomes more purposeful, and programme quality becomes more sustainable.
References and further reading
National Board of Accreditation (NBA), Evaluation Guidelines with Indicative Exhibits/Context to Be Observed/Assessed — SAR Tier-II (UG Engineering), First-Time Accreditation. Official NBA evaluation guidelines.
SAR Tier – II (UG Engineering)NBA, Manual for Accreditation of Undergraduate Engineering Programs, Tier-II Institutions. Official NBA manual PDF.
NBA InternationalNBA, Self-Assessment Report Format — Undergraduate Engineering Programs, Tier-II Institutions, January 2025. SAR format and contents.
FlipHTML5
Editorial note: The marks and numbering in this article follow the earlier Tier-II Continuous Improvement framework. Before using it in an official SAR, accreditation handbook or institutional policy, verify the current applicable NBA manual and SAR requirements.
Comments
Post a Comment
"Thank you for seeking advice on your career journey! Our team is dedicated to providing personalized guidance on education and success. Please share your specific questions or concerns, and we'll assist you in navigating the path to a fulfilling and successful career."