AI Innovation Lab (for VET)
The Future of Testing: Where AI Meets Pedagogy.Next-Generation Assessment
Welcome to the AI Innovation Lab, your digital space for experimentation, discussion, and real-world solutions. Here, we’re turning the challenges of AI into a new standard for legally compliant assessments in vocational education and training.
The world of generative AI is transforming the educational landscape at lightning speed. We’re not waiting to see how the assessment of tomorrow will evolve—we’re building it.
“The goal is not to prevent AI from being used in exams, but to design exams so well that AI enhances them rather than undermining them.”
The lab is not a theoretical seminar. It is a space for action centered around three innovation clusters:
- Visionary Task Culture (Exam Task Innovation): AI can generate pure knowledge-based questions without any randomness. We develop task formats that challenge students’ judgment and reflective skills—designed so intelligently that AI becomes a partner rather than a “ghostwriter.”
- Intelligent Processes (Exam Administration Innovation): We are rethinking exam organization. Experience how digital tools not only digitize administration but also radically simplify it and make it more accessible.
- Precision & Workload Reduction (Exam Grading Innovation): How can AI support us in grading without undermining pedagogical autonomy? We test feedback systems that save time and enhance objectivity.
The Innovation Lab is based on the research report titled “AI-Driven Innovations in Vocational Testing: Empirical Approaches to Next-Generation Assessment through the Establishment of a Collaborative AI Innovation Lab.” The research findings serve as the foundation for integrating AI into the test development process in a targeted and resource-efficient manner.
In addition, as part of the Lab, we compile findings that we consider scientifically interesting or relevant to practice. So the Lab is growing—join us!
Three Innovation Clusters
Scope for innovation
Cluster A - Innovation in Exam Questions Smart Tasks
Cluster A analyzes exam questions from commercial vocational training in the context of the increasing use of AI. The focus is on the assumption that open-ended questions requiring extensive justification and a high degree of judgment are less susceptible to AI and are therefore particularly suitable for exams. The study examines the extent to which existing tasks can be solved with AI support and thus need to be designed to be “AI-proof” or whether they produce AI-induced errors. To this end, 102 exam tasks are analyzed across 14 AI systems using a test prompt to assess structural features, typical error patterns, and required AI competencies.
Cluster B - Innovation in Exam Administration Next Gen Admin
Generative AI has the potential to revolutionize training in business-related professions. This places new demands on trainers to develop and apply skills in working with this new technology. The integration of AI requires an awareness of the legal framework that ensures the responsible use of the technology while upholding ethical standards and data protection. In Cluster B, these issues are discussed with exam administrators to derive reliable conclusions about the potential and risks of AI in the exam process.
Cluster C - Innovation in Exam Evaluation AI Assisted Grading
AI systems can play a valuable role in assessment processes. With this in mind, Cluster C investigates how effective AI is as an assessment tool. To this end, human grading is compared with AI-generated grading. The goal is to use detailed analyses to identify patterns that allow for the classification of task categories: those in which AI evaluation yields results nearly as consistent as those of human graders, and those in which this is not the case—or where the discrepancies are so significant that they distort the assessment results.
– This website is currently under construction –