Quality Assurance & Certification Framework
Checklist version
The aim of this checklist version is to help Skills4EOSC partners in getting familiar with the framework in the design of their curricula and materials. The QA indicators are organised in 4 sub-framework (Generic QA, MVS compliance, FAIR-by-design methodology compliance and ELSI subframework) and 2 categories (essential and non-essential indicators).
- Essential indicators: a set of minimum QA and certification indicators applicable to all learning objects, regardless of granularity, in conjunction with an additional collection of indicators for assessing learning objects with greater granularity.
- Non-essential indicators: only apply to more detailed learning materials with higher level of granularity (like a lesson instead of just a small piece). These indicators should be seen as recommendations.
Sub-frameworks
Info
GENERIC ASPECTS
Check your materials' generic aspects here
Info
FAIR-BY-DESIGN METHODOLOGY
Check your materials' compliance with the FAIR-by-design methodology here
Info
MVS COMPLIANCE
Check your materials' compliance with the MVS here
Info
ELSI ASPECTS
Check your materials' compliance with the ELSI aspects here
Generic sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Title
Learning objectives/outcomes
...clearly describes what it offers in its title
has specific, well-defined and measurable learning objetives and outcomes
Target audience
Program
...clearly states its target audience
... clearly describes its program
Expertise level
Dates
...states the expertise level required from its audience
... states the dates the training takes places
Date
Duration
... states the date when it was published and/or the date of yje newest version
... states the expected duration of the training
Developer/autor
Trainer
... specifies the developer/author of the resource
... specifies the trainer/s
Assesment
Language
each content or instructional unit ends with an activity/assignment (student feedback) Assessment strategies are consistent with course objectives and are clearly stated
...states the language used
Costs
... includes information regarding whether the access to it implies costs
Grading policy
... provides a grading policy in a manner that clearly defines expectations for the course and respective assignments
Delivery method
... states its delivery method (live sessions, self-learning, hybrid, face-to-face)
Micro-credentials
... consists of micro-credentials that can be aligned to create a larger milestone credential
Keywords
Learning styles
... includes relevant keywords related to the content and structute
... covers different learning styles (more student engagement), not overly relying on one learning style /e.g. reading/writing)
Prerequisites
Tools/software
... includes the prerequisites for understanding or use the learning material or its topics
... explains the required tools, software or infrastructure and the instructions for acceptable assignment submission types
Goal
... includes its goal
FAIR-by-design sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Feedback (co-creation)
Accessibility checker
... includes the possibility to provide feedback or comments from users and-or trainers/designers. Regularly gather and analyse that feedback
... has passed an accessibility checker tool to improve the accessibility of its files (PDF, HTML, video...
Access rules
Open community
... includes access rules (authentication & authorisation)
... adopts an open community approach regarding its quality and reachability
Metadata schema
... uses the RDA minimal (or domain specific) metadata schema for the learning material description
Instructor kit
... includes an instructor kit that aids in facilitating the process of others reusing the material by offering how-to guides
Metadata format
... provides its metadata in both human- and machine-readable format (e.g JSON, XML or YAML
Versioning system
... has a versioning system to track and control changes in your materials
Open file formats
Instructional backward design
... is available in open file formats (tool agnostic and compatible with a wide variety of existing software)
... its creation has implied following the stages of the backward instructional design
Repository
... is registered or indexed in at least one searchable repository (incl. instructors’ info)? and the repository is trustworthy/well-known
Learning object
... represents a complete learning object or aggregation consisting of content, tools and implementation resources defined around a minimum one learning objective
Licenses
... is there clear attribution for all reused resources with compatible licences?
Controlled vocabularies
Licenses
... uses controlled vocabularies (CVs) for describing its characteristics aligned with the chosen metadata schema
... is available for use by defining a permissible licence or policy information that allows derivations
Catalogue
... is searchable in at least one relevant catalogue. The catalogue is FAIR (it can be searched based on metadata)
Learning experience quality
Access rules
... explicitly communicates access rules (how to access, e.g. registration procedure) to learners
... has been checked by a third party regarding its learning experience quality
MVS sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Goal
Learning objectives/outcomes
... has a goal in line with the mission of the MVS profile for the stated target audience
... has learning objectives and outcomes that are relevant to any of the outcomes of the MVS profile for the stated target audience? (Section: "Contributes to which Open Science outcomes?")
Keywords
... introduces the MVS elements and concepts from an Open Science taxonomy or controlled vocabulary in its keywords
Activities and assignments
... has activities and assignments that help the stated target audience to perform any of the 'Main activities' in the MVS"
Metadata
... has a coherently structured content for all elements of the MVS in its metadata
Skills and competences
... helps the target audience in acquiring knowledge and skills that would help them to demonstrate any of the 'essential skills and competences' in an MVS relevant to their role"
Technological prerequisites
... states the technological prerequisites (tools, software and infrastructure requirements and skills) aligned with the essential skills and competences listed in the correspondent MVS profile of the stated target audience (if applicable)
Domain prerequisites
... states its domain prerequisites and aligned with the essential skills and competences listed in the correspondent MVS profile of the stated target audience (if applicable)
ELSI sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
IPR: restrictions
Terms of Service (ToS)
... includes, if needed, any restrictions from cultural heritage law (e.g. in the use of pictures), personality rights and/or other rights that may require additional licence/authorization
... provides or refers to ToS. ToS is versioned
Intellectual Property Rights (IPR)
Program
... the identity of the author / inventor or other IP originator is identified
... provides URL location of the licence or policy of the material/s (if applicable)
IPR licensing
... provides the standard licences used
IPR licensing
... has its licence versioned?
IPR licensing
IPR licensing
... provides a machine and human readable version of the licence
... has a licence compliant with Free Cultural Work or the Free Software Foundation (FsF) definition?
IPR licensing
... has interoperable licences
IPR licensing
Ethics information
... its license is Open Permissive
... includes attribution to the data source?
IPR licensing
Data provenance
... its licence is Open Protective (Copyleft)
... provides data provenance
Personal Data
ToS
... provides further proccessing provisions (if allowed)
... provides ToS authentications / registration sections (if needed)
Personal data
ToS
... provides data subjects rights and communication addresses (
... provides ToS information about charging and quotas (if neede)
Ethics information
IPR
... provides ethical rules
... the types of Intellectual Property (IP) and other types of rights subsist in a resource identified
Ethics information
... provides a Code of Conduct
IPR
Public Sector Information
... provides the provenance or other type of IP acquisition related information
... is identified as research data under the Open Data Directive
Licensing: Public Domain
... includes a Public Domain equivalent licence
Public Sector Information
IPR: Trade Secrets
... is identified as High-Value Dataset
... contains any Trade Secrets
MVS sub-framework
In this sub-framework, we reflect the specific features that a learning material should include in terms of minimum content already defined in task 2.1 in Skills4EOSC (D2.1 Catalogue of OS Career Profiles and MVS) as Minimum Viable Skillset.
Generic sub-framework
This section or sub-framework considers indicators for learning resources quality assurance taking into account generic properties applicable to any kind of learning objects, including those focusing on Open Science (OSLR).
ELSI sub-framework
In this sub-framework we reflect the specific features that the OSLR (Open Science Learning Resources), material or courses should include related to Ethical, Legal, and Social issues. The indicators refer to the learning material itself not to the content of ELSI as a crucial training issue in the realm of Open Science.
FAIR-by-design sub-framework
The FAIR-by-design process generates a new final learning package and ensures its availability on relevant platforms, and various steps (such as metadata definition, facilitator package inclusion, and cataloguing) are involved. To streamline this process and eliminate unnecessary duplication of efforts, we strongly encourage integrating the FAIR principles from the outset of the design process. This involves implementing FAIR principles throughout every phase of learning material development, from conception to release. Thus, the FAIR-by-design methodology is another key sub-framework to inspire indicators and best practices that guarantees the quality of the resources from this specific point of view.
Skills4EOSC_QA_Checklist_V1
marina.sm957
Created on December 10, 2023
Start designing with a free template
Discover more than 1500 professional designs like these:
View
Timeline Lines Mobile
View
Major Religions Timeline
View
Timeline Flipcard
View
Timeline video
View
Images Timeline Mobile
View
Sport Vibrant Timeline
View
Decades Infographic
Explore all templates
Transcript
Quality Assurance & Certification Framework
Checklist version
The aim of this checklist version is to help Skills4EOSC partners in getting familiar with the framework in the design of their curricula and materials. The QA indicators are organised in 4 sub-framework (Generic QA, MVS compliance, FAIR-by-design methodology compliance and ELSI subframework) and 2 categories (essential and non-essential indicators).
Sub-frameworks
Info
GENERIC ASPECTS
Check your materials' generic aspects here
Info
FAIR-BY-DESIGN METHODOLOGY
Check your materials' compliance with the FAIR-by-design methodology here
Info
MVS COMPLIANCE
Check your materials' compliance with the MVS here
Info
ELSI ASPECTS
Check your materials' compliance with the ELSI aspects here
Generic sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Title
Learning objectives/outcomes
...clearly describes what it offers in its title
has specific, well-defined and measurable learning objetives and outcomes
Target audience
Program
...clearly states its target audience
... clearly describes its program
Expertise level
Dates
...states the expertise level required from its audience
... states the dates the training takes places
Date
Duration
... states the date when it was published and/or the date of yje newest version
... states the expected duration of the training
Developer/autor
Trainer
... specifies the developer/author of the resource
... specifies the trainer/s
Assesment
Language
each content or instructional unit ends with an activity/assignment (student feedback) Assessment strategies are consistent with course objectives and are clearly stated
...states the language used
Costs
... includes information regarding whether the access to it implies costs
Grading policy
... provides a grading policy in a manner that clearly defines expectations for the course and respective assignments
Delivery method
... states its delivery method (live sessions, self-learning, hybrid, face-to-face)
Micro-credentials
... consists of micro-credentials that can be aligned to create a larger milestone credential
Keywords
Learning styles
... includes relevant keywords related to the content and structute
... covers different learning styles (more student engagement), not overly relying on one learning style /e.g. reading/writing)
Prerequisites
Tools/software
... includes the prerequisites for understanding or use the learning material or its topics
... explains the required tools, software or infrastructure and the instructions for acceptable assignment submission types
Goal
... includes its goal
FAIR-by-design sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Feedback (co-creation)
Accessibility checker
... includes the possibility to provide feedback or comments from users and-or trainers/designers. Regularly gather and analyse that feedback
... has passed an accessibility checker tool to improve the accessibility of its files (PDF, HTML, video...
Access rules
Open community
... includes access rules (authentication & authorisation)
... adopts an open community approach regarding its quality and reachability
Metadata schema
... uses the RDA minimal (or domain specific) metadata schema for the learning material description
Instructor kit
... includes an instructor kit that aids in facilitating the process of others reusing the material by offering how-to guides
Metadata format
... provides its metadata in both human- and machine-readable format (e.g JSON, XML or YAML
Versioning system
... has a versioning system to track and control changes in your materials
Open file formats
Instructional backward design
... is available in open file formats (tool agnostic and compatible with a wide variety of existing software)
... its creation has implied following the stages of the backward instructional design
Repository
... is registered or indexed in at least one searchable repository (incl. instructors’ info)? and the repository is trustworthy/well-known
Learning object
... represents a complete learning object or aggregation consisting of content, tools and implementation resources defined around a minimum one learning objective
Licenses
... is there clear attribution for all reused resources with compatible licences?
Controlled vocabularies
Licenses
... uses controlled vocabularies (CVs) for describing its characteristics aligned with the chosen metadata schema
... is available for use by defining a permissible licence or policy information that allows derivations
Catalogue
... is searchable in at least one relevant catalogue. The catalogue is FAIR (it can be searched based on metadata)
Learning experience quality
Access rules
... explicitly communicates access rules (how to access, e.g. registration procedure) to learners
... has been checked by a third party regarding its learning experience quality
MVS sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
Goal
Learning objectives/outcomes
... has a goal in line with the mission of the MVS profile for the stated target audience
... has learning objectives and outcomes that are relevant to any of the outcomes of the MVS profile for the stated target audience? (Section: "Contributes to which Open Science outcomes?")
Keywords
... introduces the MVS elements and concepts from an Open Science taxonomy or controlled vocabulary in its keywords
Activities and assignments
... has activities and assignments that help the stated target audience to perform any of the 'Main activities' in the MVS"
Metadata
... has a coherently structured content for all elements of the MVS in its metadata
Skills and competences
... helps the target audience in acquiring knowledge and skills that would help them to demonstrate any of the 'essential skills and competences' in an MVS relevant to their role"
Technological prerequisites
... states the technological prerequisites (tools, software and infrastructure requirements and skills) aligned with the essential skills and competences listed in the correspondent MVS profile of the stated target audience (if applicable)
Domain prerequisites
... states its domain prerequisites and aligned with the essential skills and competences listed in the correspondent MVS profile of the stated target audience (if applicable)
ELSI sub-framework
ESSENTIAL
NON-ESSENTIAL
The learning resource...
The learning resource...
IPR: restrictions
Terms of Service (ToS)
... includes, if needed, any restrictions from cultural heritage law (e.g. in the use of pictures), personality rights and/or other rights that may require additional licence/authorization
... provides or refers to ToS. ToS is versioned
Intellectual Property Rights (IPR)
Program
... the identity of the author / inventor or other IP originator is identified
... provides URL location of the licence or policy of the material/s (if applicable)
IPR licensing
... provides the standard licences used
IPR licensing
... has its licence versioned?
IPR licensing
IPR licensing
... provides a machine and human readable version of the licence
... has a licence compliant with Free Cultural Work or the Free Software Foundation (FsF) definition?
IPR licensing
... has interoperable licences
IPR licensing
Ethics information
... its license is Open Permissive
... includes attribution to the data source?
IPR licensing
Data provenance
... its licence is Open Protective (Copyleft)
... provides data provenance
Personal Data
ToS
... provides further proccessing provisions (if allowed)
... provides ToS authentications / registration sections (if needed)
Personal data
ToS
... provides data subjects rights and communication addresses (
... provides ToS information about charging and quotas (if neede)
Ethics information
IPR
... provides ethical rules
... the types of Intellectual Property (IP) and other types of rights subsist in a resource identified
Ethics information
... provides a Code of Conduct
IPR
Public Sector Information
... provides the provenance or other type of IP acquisition related information
... is identified as research data under the Open Data Directive
Licensing: Public Domain
... includes a Public Domain equivalent licence
Public Sector Information
IPR: Trade Secrets
... is identified as High-Value Dataset
... contains any Trade Secrets
MVS sub-framework
In this sub-framework, we reflect the specific features that a learning material should include in terms of minimum content already defined in task 2.1 in Skills4EOSC (D2.1 Catalogue of OS Career Profiles and MVS) as Minimum Viable Skillset.
Generic sub-framework
This section or sub-framework considers indicators for learning resources quality assurance taking into account generic properties applicable to any kind of learning objects, including those focusing on Open Science (OSLR).
ELSI sub-framework
In this sub-framework we reflect the specific features that the OSLR (Open Science Learning Resources), material or courses should include related to Ethical, Legal, and Social issues. The indicators refer to the learning material itself not to the content of ELSI as a crucial training issue in the realm of Open Science.
FAIR-by-design sub-framework
The FAIR-by-design process generates a new final learning package and ensures its availability on relevant platforms, and various steps (such as metadata definition, facilitator package inclusion, and cataloguing) are involved. To streamline this process and eliminate unnecessary duplication of efforts, we strongly encourage integrating the FAIR principles from the outset of the design process. This involves implementing FAIR principles throughout every phase of learning material development, from conception to release. Thus, the FAIR-by-design methodology is another key sub-framework to inspire indicators and best practices that guarantees the quality of the resources from this specific point of view.