Assessment of the Criteria

The assessment of quality indicators using these criteria takes place in maximally two rounds:

1. For each criterion, a different questionnaire is handed out with the following assessment scale:
   1 = does not apply
   2 = rather does not apply
   3 = rather applies
   4 = applies
   Abstention
   
   All quality indicators to be assessed can be listed in a table on the questionnaire. For each quality indicator only one answer is allowed. Abstentions are possible.
2. The results of the first assessment round are collected and analyzed.
3. If there is a complete count of votes and simultaneously consensus is obtained from the assessments (for a criterion related to a quality indicator), the evaluation of this quality indicator for the respective criterion is completed.
   Complete count of votes: All assessments are valid and there is no abstention.
   Consensus: All assessments “1 = does not apply” or “2 = rather does not apply”
   (consensus: rejection) and accordingly “3 = rather applies” or “4 = applies” (consensus: acceptance)
   Example: Quality indicator wound infection, criterion benefit:
   - No abstention
   - 80% of votes: “3 = rather applies”
   - 20% of votes: “4 = applies”
4. In the absence of a complete count of votes (caused by abstentions or invalid assessments) or if there is disagreement during the first round of assessments, the aggregated results will be discussed in the evaluation committee with the goal of exchanging information. A consensus must not be forced.
   Example: quality indicator wound infection, criterion benefit:
   - 80% of votes: “1 = does not apply”
   - 20% of votes: “3 = rather applies”
5. The members vote again (second and final assessment round). The assessment is done as in the first round.
6. The evaluations of the second assessment round are collected and analyzed:
   The assessment is valid if less than1/3 of evaluators present did not participate in the assessment (abstention).
   With an invalid assessment in the second round, a further assessment is omitted.
7. Presentation of assessment results:
   In case of a valid assessment result: Calculation of the rounded mean and reporting of the range (rounding rule: 1,50 is rounded down to 1: 2,50 is rounded down to 2, but 2,51 is rounded up to 3).
   Example: Quality indicator x, criterion y
   - Five single assessments: 1, 2, 2, 4, 2: this results in an arithmetic mean of 2,2.
   - Assessment result: a rounded down mean: “2 = rather does not apply”, range 1-4.
   
   In case of an invalid assessment result: Quality indicator x: for the criterion y, a valid assessment is not obtained.