Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to Codidact Meta!

Codidact Meta is the meta-discussion site for the Codidact community network and the Codidact software. Whether you have bug reports or feature requests, support questions or rule discussions that touch the whole network – this is the site for you.

Post History

84%
+14 −1
Q&A Scoring System for Trust Level Requirements

Currently, we're planning to implement a system for user privileges based on Trust Levels. These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [these requir...

2 answers  ·  posted 4y ago by Mithrandir24601‭  ·  last activity 4y ago by Monica Cellio‭

#3: Post edited by user avatar Sigma‭ · 2020-06-28T23:39:22Z (over 4 years ago)
  • Currently, we're planning to implement a system for [user priviledges based on Trust Levels](https://github.com/codidact/docs/wiki/User-Privileges).
  • These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [[these requirements]](https://docs.google.com/spreadsheets/d/1RzHFAHEm2XEnUpkNVocAOHw5MNi3ABD8FxIIuTpLn_M/edit#gid=0) are generally of the form e.g. "at least 50 accepted edits".
  • Continuing this example, what this *doesn't* take into account is the number of *rejected* edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.
  • At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, *we're already using* a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our [post scoring system](https://github.com/codidact/docs/wiki/Functional-Specification#votes-and-scores).
  • I'm therefore proposing that we **use this same scoring system to 'score' each individual requirement in the Trust Levels**: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.
  • As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as
  • ![Radar chart for user scores](https://meta.codidact.com/uploads/RJ2mS3kewtAAiGcMTdjdzU18)
  • Currently, we're planning to implement a system for [user privileges based on Trust Levels](https://github.com/codidact/docs/wiki/User-Privileges).
  • These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [[these requirements]](https://docs.google.com/spreadsheets/d/1RzHFAHEm2XEnUpkNVocAOHw5MNi3ABD8FxIIuTpLn_M/edit#gid=0) are generally of the form e.g. "at least 50 accepted edits".
  • Continuing this example, what this *doesn't* take into account is the number of *rejected* edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.
  • At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, *we're already using* a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our [post scoring system](https://github.com/codidact/docs/wiki/Functional-Specification#votes-and-scores).
  • I'm therefore proposing that we **use this same scoring system to 'score' each individual requirement in the Trust Levels**: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.
  • As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as
  • ![Radar chart for user scores](https://meta.codidact.com/uploads/RJ2mS3kewtAAiGcMTdjdzU18)
#2: Post edited by user avatar Mithrandir24601‭ · 2020-06-19T19:02:26Z (over 4 years ago)
  • Currently, we're planning to implement a system for [user priviledges based on Trust Levels](https://github.com/codidact/docs/wiki/User-Privileges).
  • These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [[these requirements]](https://docs.google.com/spreadsheets/d/1RzHFAHEm2XEnUpkNVocAOHw5MNi3ABD8FxIIuTpLn_M/edit#gid=0) are generally of the form e.g. "at least 50 accepted edits".
  • Continuing this example, what this *doesn't* take into account is the number of *rejected* edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.
  • At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, *we're already using* a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our [post scoring system](https://github.com/codidact/docs/wiki/Functional-Specification#votes-and-scores).
  • I'm therefore proposing that we **use this same scoring system to 'score' each individual requirement in the Trust Levels**: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.
  • As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as
  • ![Radar chart for user scores](https://meta.codidact.com/uploads/RJ2mS3kewtAAiGcMTdjdzU18)
  • Currently, we're planning to implement a system for [user priviledges based on Trust Levels](https://github.com/codidact/docs/wiki/User-Privileges).
  • These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [[these requirements]](https://docs.google.com/spreadsheets/d/1RzHFAHEm2XEnUpkNVocAOHw5MNi3ABD8FxIIuTpLn_M/edit#gid=0) are generally of the form e.g. "at least 50 accepted edits".
  • Continuing this example, what this *doesn't* take into account is the number of *rejected* edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.
  • At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, *we're already using* a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our [post scoring system](https://github.com/codidact/docs/wiki/Functional-Specification#votes-and-scores).
  • I'm therefore proposing that we **use this same scoring system to 'score' each individual requirement in the Trust Levels**: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.
  • As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as
  • ![Radar chart for user scores](https://meta.codidact.com/uploads/RJ2mS3kewtAAiGcMTdjdzU18)
#1: Initial revision by user avatar Mithrandir24601‭ · 2020-06-19T19:00:16Z (over 4 years ago)
Currently, we're planning to implement a system for [user priviledges based on Trust Levels](https://github.com/codidact/docs/wiki/User-Privileges).

These are of the form of 'if you satisfy [these requirements], you get [these perks]', where [[these requirements]](https://docs.google.com/spreadsheets/d/1RzHFAHEm2XEnUpkNVocAOHw5MNi3ABD8FxIIuTpLn_M/edit#gid=0) are generally of the form e.g. "at least 50 accepted edits".

Continuing this example, what this *doesn't* take into account is the number of *rejected* edits - if a user has 50 accepted edits out of a total of 200 suggested edits (i.e. has 150 rejected edits), then I for one would be hesitant to give that user the ability to directly edit.

At this point, it appears that the solution would be to come up with some method of figuring out the number of accepted edits in order to 'balance out' the rejected edits, or having some some system of '> x accepted edits and < y rejected edits within the past [some time-scale]'. However, *we're already using* a system that estimates the probability of a successful outcome of a binary choice (e.g. 'accept' and 'reject'), given some data. That is, our [post scoring system](https://github.com/codidact/docs/wiki/Functional-Specification#votes-and-scores).

I'm therefore proposing that we **use this same scoring system to 'score' each individual requirement in the Trust Levels**: (accepts + N) / (accepts + rejects + 2N), for N=2. The requirement of 'at least 50 accepted edits' could then be replaced with a requirement of 'an edit-score of at least 0.95'. This could similarly be applied to create a user post-score, where 'accepts' is the total number of upvotes across all posts and 'rejects' is the total number of downvotes.

As we're planning on getting rid of rep and not replacing it with any number (other than trust levels), an individual user's score should perhaps only be visible to that user. For easy visualisation, it could also be displayed in a radar chart such as 

![Radar chart for user scores](https://meta.codidact.com/uploads/RJ2mS3kewtAAiGcMTdjdzU18)