02/04/25 UPDATE: Judges can now submit entries to challenges they're evaluating, as long as they don't vote for their own submissions.
Since launc...
For further actions, you may consider blocking this person and/or reporting abuse
While I appreciate the initiative to involve the community in judging, I’m curious about the mechanisms in place to ensure the integrity of the judging process. Given that judges are self-selecting based on their expertise, how do you plan to prevent potential biases, especially if a judge has a personal or professional stake in a submission? Additionally, could you elaborate on how the feedback collected from judges will be integrated into the final decision-making process? I believe transparency in these areas will not only enhance trust in the community but also contribute to the overall quality and fairness of the challenges....
Hey @shafayeat, we will not take a judge's feedback into consideration if they have participated in the challenge they are attempting to judge.
Our team at DEV will continue to judge each submission and are reviewing overall feedback from community judges as a quality signal, not a determinator.
Thanks, @jess ! That makes a lot of sense. It’s reassuring to know that DEV’s team still oversees the final call while using community feedback as a quality check.
This sounds great. I've just submitted my application and look forward to it.
Suppose a person submits an entry for a challenge. Automatically, they can't be chosen as a judge for that challenge. Is that correct?
@sarahokolo that's correct -- judge recommendations won't be considered if they have also submitted to the associated challenge!
I know the work load is heavy for Dev and as such, more hands needed but, someway, somehow, I'm seeing favoritism coming into play from the side of volunteer judges. I might not be participating in a challenge, but my good paddy might be participating and favoritism is more likely to play a role in the review process, than actual factual review. Or, the sound of my name and where I'm coming from, might be the deciding factor than my actual work.
Hard to spend 40+hrs on a project and submit, knowing very well it won't be reviewed first hand by Dev team or the organizing company but rather volunteers that probably have their own marking schemes.
I kindly appeal to Dev to look into this. I prefer challenges having longer review periods with a small team, than this approach.
Hey @akiwams, our team at DEV will continue to judge each submission and are reviewing overall feedback from community judges as a quality signal, not a determinator.
I would love to be a judge