Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to Codidact Meta!

Codidact Meta is the meta-discussion site for the Codidact community network and the Codidact software. Whether you have bug reports or feature requests, support questions or rule discussions that touch the whole network – this is the site for you.

Comments on Scoring System for Trust Level Requirements

Post

Scoring System for Trust Level Requirements

+14
−1

Currently, we're planning to implement a system for user privileges based on Trust Levels.

These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [these requirements] are generally of the form e.g. "at least 50 accepted edits".

Continuing this example, what this doesn't take into account is the number of rejected edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.

At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, we're already using a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our post scoring system.

I'm therefore proposing that we use this same scoring system to 'score' each individual requirement in the Trust Levels: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.

As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as

Radar chart for user scores

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

1 comment thread

General comments (6 comments)
General comments
Zerotime‭ wrote over 4 years ago

Can you please reupload the image in a higher resolution? The only thing I can read is "Score for (user)".

Mithrandir24601‭ wrote over 4 years ago

@Zerotime The formatting, font size etc. would need to be improved, but here's a link to another one

Monica Cellio‭ wrote over 4 years ago

I think this approach would simplify things for all involved.

Cazadorro‭ wrote over 4 years ago · edited over 4 years ago

what is N conceptually here? Is it just some constant? What is it's purpose? Also don't we still need to take into effect timescale, or maybe just the last X number of accept rejects to help people who've gotten better/worse at edits over time?

Mithrandir24601‭ wrote over 4 years ago

N is just some constant, yep. My opinion on the timescale thing is that it doesn't matter if someone rarely edits, as long as they're consistently good at it, while someone who had a bad string of edits to start with, but improves, will see a gradual increase in score. Maybe your idea of 'last X number of...' is the way to go here?

Monica Cellio‭ wrote over 4 years ago

Related: https://meta.codidact.com/questions/276618. This question has a lot of support; if no one else does it first I'll try to propose a reworking of trust levels along these lines, as an answer to this question. I think we can make trust "levels" more independent, and in fact we had already identified one level that needs two variants. Maybe they're not necessarily sequential even if there's a typical path. Needs more thought.