How Cisco Maintains Certification Quality
At Cisco, we know that before you invest in a professional certification program, you want the confidence that it will be worth your time, effort, and money. That’s why Cisco puts a lot of its own time, effort and money into making sure our certification program and exams are among the best in the IT industry.
So how does Cisco ensure that its certifications are among the best? The short answer is by taking many precautions to ensure that our certifications are useful to hiring managers.
To that end, one important step is job-role and task analysis; research processes that we use to ensure that Cisco certifications are aligned with in-demand networking roles, and the associated tasks and skills. This 3-part effort involves many networking experts drawn from Cisco customer, partner and internal organizations to identify workplace demands and related Cisco skill requirements via structured interviews, focus groups and surveys. The output of all this activity is the “exam blueprint” – a high-level outline of minimum-competence certification standards which guide the exam creation process, which is published in the certification materials to tell candidates how to prepare. (See this blog post about a recent discussion of routing and switching certification design.)
When we are ready to create a certification exam, more experts are assembled to write exam questions, including labs, simulations, and other performance-based items. Their expertise is used to directly evaluate the most important skills candidates will need in the real-world. The creation of exam questions is a highly structured process with numerous checks on the accuracy of the technical content, and further checks on the quality of the questioning, language and answer options.
Once an exam is initially developed, we refine it through an extensive beta testing process; we recruit qualified candidates to take the beta exam and provide further input on the clarity and accuracy of the questions. Beta exam results, including comments, are then analyzed by the exam team to assess the validity and reliability of each question. On the basis of this analysis, we determine which exam questions should be kept, revised, or removed from the final version of the exam. Once an exam is live, we check the quality of our exam items on an ongoing basis by reviewing item performance and reviewing candidate comments.
The final step in exam creation is to determine an appropriate passing score. Again, to ensure that passing scores reflect real-world expectations of competence, we turn to experts in customer, partner and internal organizations to evaluate the difficulty and relevance of each question against workplace requirements.
At Cisco, we know that the creation of trusted certification exams requires inclusiveness as well as science and creativity. Demand for Cisco certifications is strong and growing because hiring managers value alignment with real-world job responsibilities, demonstration of highly-important skilled tasks, and the judgment of experts and peers regarding standards of competence.
From the Learning@Cisco Certification Exam Design and Development Team
Robin Lee :: Nov.19.2008 :: Cisco CCNA News :: No Comments »