Interpret and moderate results in Buddycheck (Ultra)
In Buddycheck you will be able to see the following results:
- Scores - individual results for each student
- Messages/responses - peer messages and responses to open questions
- Groups - group results
Scores
The whole cohort's results
As soon as the students start to submit their evaluations, you will be able to view data in the format as shown on the graph below:
- Labels: click on the ? to view a description of each label. Please refer to Interpret Buddycheck results guide to get detailed information on what each label means.
- Avg: Average factor (sum of all grades divided by the number of students in the group)
- Factor: An Adjustment Factor value is calculated using the peer questions. It attempts to show the contribution of a given student relative to the other members of their team. Specifically, the Adjustment Factor is the average rating of the student divided by the overall average rating for all members of the team. With Self means that one the student self-ratings factored in. In some cases, the exceptional conditions described above may have an impact on the validity of these Adjustment Factor values, and in these cases the Adjustment Factor columns will be highlighted.
- Reliable: The Buddycheck reliability score can be used as an indicator to quickly check if the evaluation is reliable or if it might be better to send a reminder to those who did not fill in the evaluation to get a more trustworthy evaluation result. Reliability is based on three criteria: standard deviation, a minimum of two completed evaluations, and group size relative to missing evaluations.
Below is an example of unreliable results: only 2 of the 4 members have submitted their evaluations.
Below is an example of unclear results: 1 out of 4 group members have not submitted their evaluation.
Below is an example of reliable results: all or a large percentage of the group members have submitted their evaluations.
- Submitted: Submission time
Individual results
Click on the name of each student to view their detailed results:
- Received: results that the students received from their peers
- Given: scores given by that student to their peers
- Team questions: responses given by the students to the team questions
- Personal report: view the student's results in the graph format
- Group report: view the group results in the graph format.
Mute scores
In the case that one student's evaluation is unjustifiably influencing the group members' results, you can remove that particular student's scores.
- Click on the required evaluation in Buddycheck.
- The results that require your moderation will be highlighted.
- Click on the name of the student whose scored are highlighted.
- Click on the Edit scores button.
- Read the motivation of scores that the student 1 is given to student 2 and if the scores are unjustified, click on the x next to the student 2 name to remove all the scores by that student OR click on the x next to a particular question to mute the score for that question.
- Click on the Save changes button.
Moderate messages/responses
- In the required evaluation in Buddycheck, click on the Messages/responses tab.
- Review the peer messages given.
- All Peer messages MUST be moderated before the results can be released to the students. Click on the Mute tab next to the message with unprofessional feedback. The message will become crossed out, will stay in the system (this allows you to discuss the feedback with the student who gave it), but will not be included in the results to be released to the students.
Groups
In the Groups section you will be able to see the list of groups in the evaluation and the following data:
- Group - Group names
- Group avg - average (Likert sor divided points)
- Group members
- Moderated - after you have moderated a group, the status will become Yes, otherwise No
- Completion - displays % of the students who completed the evaluation
- Labels - labels are generated automatically by Buddycheck based on the students scores. Refer to Labels in Buddycheck guide for detailed explanations on what each label means.
- Click on the name of the group with the labels that require your attention (e.g. Conflict, Tension etc.)
- Column 1 will show the list of students who gave the scores and horisontally will be the recipients of the scores.
- Click on Edit scores button. You can then click on any score and it will become muted (it will be excluded from the calculations, but will stay in the system so you can revert it if necessary).
Example: Student buddycheck03 gave themself a 5, while rating other students at 1 or 2 and did not give any explanations (no messages). After comparing the score they gave to the scores other students gave, it was clear that their scores are unjustified, therfore they were muted. This removed their scores from the evaluation and the overall results changed.
- Click on the Save changes button.
