Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Blog

Welcome to Codidact Meta!

Codidact Meta is the meta-discussion site for the Codidact community network and the Codidact software. Whether you have bug reports or feature requests, support questions or rule discussions that touch the whole network – this is the site for you.

Comments on Coming soon: new abilities system and changes to reputation

Post

Coming soon: new abilities system and changes to reputation

+24
−0

One of our longstanding design goals is to grant privileges based on people's activity and not just based on a reputation number. We think it's better if you gain abilities based on your track record in related areas, and not because one of your answers hit the Reddit jackpot. We're finally almost ready to roll out this change.

With the new system, all users will be able to participate fully on their own questions -- voting and commenting. We think even brand new members of a community should be able to interact with those who are trying to provide help. Beyond that, users can earn the following abilities (not necessarily in this order):

  • Participate Everywhere: you can now vote and comment anywhere and ask more questions (new users have a limited number per day). You get this ability by having enough well-received posts.
  • Edit Posts: edit directly and review suggested edits. You get this ability by having enough of your suggested edits accepted.
  • Edit Tags: edit tag descriptions and create new tags. You get this ability by having more of your suggested edits accepted (same idea as Edit Posts, but a higher threshold).
  • Vote on Holds: vote to put questions on hold or reopen them. This ability is based on having both enough well-received posts (to show you have knowledge of the community's subject area) and enough accepted flags.
  • Curate: vote to delete/undelete, temporarily lock posts, and handle certain flags. LIke Vote on Holds, this ability is based on both your posts and your flags.
  • Moderator: elected or appointed moderators can perform all actions. (all current moderators will automatically get this ability.)

All of the thresholds for these abilities -- what counts as "enough" -- can be set for each community. We'll provide two default configurations, the normal one and a "new community" one with lower levels. Most of our communities are young and small and would benefit from the lower thresholds, but you can raise them later as your communities grow.

Along with abilities we're rolling out some daily rate limits for various activities. One of these, votes, used to be based on reputation. That was because we didn't think new users who hadn't even posted anything should be able to cast dozens of votes per day. With the Participate Generally ability, that concern is taken care of -- so we can instead just set a daily vote cap for everybody.

We have new help topics coming about all of this, and we also have improved user and moderator tools to navigate abilities. You'll be able to see what abilities you have on your user profile, and you'll be able to see what you need to do to gain the ones you don't yet have.

What about reputation?

We will no longer base your abilities on reputation, but we're not taking it away (yet?). We've heard you loud and clear: some communities and participants want a quick "score" number. Our plan is still to remove it, but we’ll be thinking of reasonable replacements that suit all communities. You can expect a separate discussion thread in a few days.

Transition

We know that some people will lose some abilities (temporarily, we hope) when we make this change. Maybe you have a high reputation from good questions and answers and you're used to being able to edit freely, but now you'll have to go back to suggesting edits for a time. We're sorry about that. We looked at what it would take to "grandfather" people in, but it got complicated. We hope that setting lower thresholds will smooth the way here, but if any community is feeling too restricted, please let us know. We can adjust the thresholds on your community or manually grant abilities in cases where it's clear people ought to have them.

Closing words

We've been working toward this for a while and we're excited to finally be rolling it out (soon). We think activity-based abilities are a key differentiator for Codidact. We hope you'll agree.

We've been doing a lot of testing and reviewing, but we've probably missed some things. If you find problems, please tag your bug reports with [abilities] so we can prioritize them. We'll be actively monitoring Meta, per-community metas, GitHub and chat.

We'll make another announcement when the changes are live.

And when you are asking where the sweet technical details are; I've written another blog post abbout how Abilities are designed.

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.

1 comment thread

General comments (21 comments)
General comments
shog9‭ wrote about 4 years ago

Fantastic! Btw, check out codeproject's rep system if you've never seen it; seems like a similar idea might tie into what you're planning here...

Lundin‭ wrote about 4 years ago

For tech/scentific sites, it definitely doesn't make much sense to make a tight coupling between moderator suitability and domain expertise. If we can manage to separate those, that would be great! Rep should probably(?) reflect domain expertise, nothing else.

Peter Taylor‭ wrote about 4 years ago

I don't understand the linkage between suggested edits and tag creation. Being good at proof-reading and reformatting text is a different skill to categorisation. Worse than that, not being able to create a tag can block someone from being able to post a question, especially in a newish site.

Peter Taylor‭ wrote about 4 years ago

Separately, one of the lessons I took from SE was that not allowing new users to comment has negative value. Either they have to abuse an answer to leave a comment, or valid critiques get lost because people don't want to (or remember to) come back after gaining rep from answers. IMO it would be better to limit new users to one comment per day plus a rebuttal to any addressed at them.

luap42‭ wrote about 4 years ago

@Lundin We'll need to discuss what rep should become (or how it should be replaced) separately. We'll start a discussion about this in a few days including some suggestions what user cards should look like.

luap42‭ wrote about 4 years ago

@PeterTaylor you make a good point about tag management. Our idea was "editing posts" < "editing tags" (and both with "editing"), but this can be changed. We can require successful posts, suggested edits and flags as possible criteria for abilities. What would you suggest (currently it could be called: "edits: high", where high is a qualifier for the amount of edits needed)

luap42‭ wrote about 4 years ago

And about comments: The rate limits can be edited by per-site. So we can react to sites where comments-as-answers are a problem. I'd leave the limit at 0 for now and revisit this later when we have actual data to verify.

Peter Taylor‭ wrote about 4 years ago

Editing tags as an extension to editing posts makes some sense, with a possible extension that people with lots of good content in a tag can edit the description of that tag. For tag creation, in a new site I think free-for-all might be the best option; in a mature site, maybe something like having good content in N tags, which suggests that you are familiar with the site's ontology? That would extend back to new sites by setting N=0.

Olin Lathrop‭ wrote about 4 years ago

Much of this sounds reasonable, but it seems like the metric of generally writing well-received answers is getting lost except for the first ability you mention. Someone with lots of good answers is going to be familiar with the site and its norms. The should lower other thresholds to get specific abilities. In other words, abilities should be based on certain actions and knowing the site well, with some squishiness between the two that can be set per site.

Olin Lathrop‭ wrote about 4 years ago

For example, someone that has read and answered a lot of questions should know how to tell good from bad questions. In fact, they are probably better at it than someone that had a few close/reopen/delete flags accepted.

Moshi‭ wrote about 4 years ago

@OlinLathrop "it seems like the metric of generally writing well-received answers is getting lost except for the first ability you mention" ... 3 of the 5 unlockable abilities rely partially on well received posts though? (Participate Generally, Vote on Holds, Curate)

Moshi‭ wrote about 4 years ago

"For example, someone that has read and answered a lot of questions should know how to tell good from bad questions. In fact, they are probably better at it than someone that had a few close/reopen/delete flags accepted." On the other hand, someone who knows how to tell good from bad questions should know when to flag and thus have more of their flags accepted. And if someone has their flags accepted, they probably know what they're doing, regardless of how active they are in posting.

Olin Lathrop‭ wrote about 4 years ago

@Moshi Right. I'm suggesting a squishy metric trading off the two. For example, you can get the ability with high accepted flag count and low contribution score, low accepted flag count and high contribution score, and combinations in between. The four limits should be settable by site.

jrh‭ wrote about 4 years ago

While it's still very early, I think this might scale better than SO's system, I always thought it was very silly that I could never get the ability to edit posts without review even if I had hundreds or thousands of approved suggested edits. One thing to note is, we might not really know how good the edit privileges are until posts have a chance to age and new users start joining that post lazily formatted content.

jrh‭ wrote about 4 years ago · edited about 4 years ago

... also I think SO's need for edits comes partially from the "never delete an answer" policy, a lot of the posts I would like to edit were technically correct but deeply flawed. The other kind are posts that are outdated due to dead links. Hypothetically if reviewers had domain knowledge I would also suggest edits to code to fix memory leaks, and other things that I would not normally think would require a new answer.

jrh‭ wrote about 4 years ago · edited about 4 years ago

...and a third thing, collecting answer and question votes on here might be a lot easier than on SO, I vaguely remember people saying that votes used to be a lot more common on SO when the site was small (more attention to each post), and plus there's tons of subjects that have zero content at all. Though if this site optimizes for quality contribution instead of "everyone should post their homework here" then maybe the decline in votes can be avoided, I hope so.

Jon Ericson‭ wrote about 4 years ago

Something to consider: Discourse uses reading stats to grant trust levels. Fundamentally it's about encouraging people to understand your community before jumping in with both feet.

luap42‭ wrote about 4 years ago

@JonEricson yeah, we used Discourse prior to this Meta site for coordination and the current Abilities system is heavily inspired by them. We currently don't track or intend to track reading and page visits. Also AFAICT, reading time generally requires JS to be active, which we intend not to demand for basic site usage, to which I'd count Abilities.

Moshi‭ wrote about 4 years ago

@luap42 "And when you are asking where the sweet technical details are; I’ll write another blog post in a few days about how abilities are designed." So, where is it? :)

Andy aka‭ wrote about 4 years ago

This is a question and answer site - this is why folk come here. Reputation/scoring should be dominated by that fact. It sounds like what is being proposed appears to be missing the point or maybe I just don't understand what an abilities system is.

luap42‭ wrote about 4 years ago

@Andyaka I don't get what you want to say? The Abilities system is based on the idea that we should give you the tools you have shown that you can be trusted to use them. Not everyone who's (for example) good at spotting off-topic posts is also good at editing posts.