Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Welcome to Codidact Meta!

Codidact Meta is the meta-discussion site for the Codidact community network and the Codidact software. Whether you have bug reports or feature requests, support questions or rule discussions that touch the whole network – this is the site for you.

Comments on Giving question feedback in private - a moderating system to reduce conflicts

Parent

Giving question feedback in private - a moderating system to reduce conflicts

+11
−3

Some background:

A discussion about deleting/preserving comments and giving user feedback popped up on Software Development meta here: How are we supposed to give feedback for poor questions if such comments are deleted? However, I believe these concerns are network-wide and should be discussed with the broader audience here on meta.codidact.

I wrote several posts about this back on the old, now deprecated Codidact forums. Here follows a modified version of an old post of mine.


Goals

  • Make new users feel more welcome.
  • Keep criticism constructive and mostly give it in private.
  • Reduce friction, conflict and elitism accusations.
  • Increase the quality of site content.
  • Don't repeat SE's mistakes.

We know from over 10 years of experience from SE/SO that one of the most common sources of drama, snark, rudeness, escalating arguments, conflicts, users feeling unwelcome, the community getting accused of elitism and so on, all originate from comments left as feedback to a potentially bad question.

SO has tried to deal with this with "welcome wagons" and other misguided attempts to improve new user experience, addressing the symptoms caused by their site design model, rather than the causes. This is the root of SO's problems: public shaming as a moderator tool.

It might perhaps work as a way to preserving content quality somewhat, but it keeps people away from the site by making them feel unwelcome or too intimidated to post. It's a design that creates maximum user friction.

The main problems of SO's model:

  • Humans often simply don’t take kindly even to constructive criticism, especially not when given in public for the world to see.

    The basics of leadership & keeping people motivated is to give praise loudly in public but to give criticism discreetly in private. This makes people far more likely to actually listen to the criticism and change.

    Solve this by removing the question from the public eye and then give private feedback to the poster.

  • Deleting posts “as slowly as possible”. Bad questions get slowly grinded down into the dust by down votes, comments, close votes, all in public, really rubbing it in. And even when it sits there with 5 close votes and -10 score, it is still published for everyone to see.

    Solve this by giving trusted users privileges to instantaneously remove a bad question from the public eye. This also minimizes friction as the question is moved away from those who haven't the slightest interest in helping new users.

  • “Bandwagon moderation”. The first veteran user who encounters a bad question and is willing to help out, often gives constructive criticisms with links to help pages etc. So far, so good - that initial polite comment is often all that’s actually needed. Yet we have subsequent users arriving later, piling on further comments or repeating what's already been said.
    It stops being constructive and derails into what the poster might interpret as “you are bad”. And it creates a negative atmosphere for everyone stumbling over that post too.

    Lots of such comments come from veteran users who are simply fed up by viewing the same endless flood of bad questions day after day. They actually don’t have much interest in helping the OP at all, they just want the crap question gone.

    Solve this by not forcing regular users to view bad content, again by quickly removing such questions away from the public eye to a “quarantine” area.

  • SO’s “crap hugging” policy of “we must preserve and publish all the crap ever posted and polish it until the end of time” is harmful. Similarly, when a question is closed since it can’t be answered and needs to be corrected by the OP alone, it is senseless to keep on displaying that question to the public.

    It is much more important for the community to reduce negative criticism and low quality content than to preserve some unsalvagable homework dump for all eternity.

  • In addition, do not force users who just want to use the site to become moderators, by having a messy rep system that assumes that people with good domain knowledge automatically make good moderators as well. This simply isn’t true. A better reputation & moderator privilege system than the one at SO is needed.

    [SOLVED] I believe the current Codidact system with privileges based on activity rather than rep solves this problem. We didn't have this system in place when I originally wrote this back on the old forums.


Proposal

  • Give trusted users and community moderators the powers to instantly close a post and move it to a "post feedback" area. Without any close vote consensus involving multiple users, similar to "dupe hammer" privilege at SO. ("Quarantine" feels loaded currently... "sandbox"? The name isn't important.)
  • This could possibly be a special kind of site category only viewable by those with an interest of helping new users. A slight tweak to the current category system perhaps?
  • The post will instantly disappear from the main site and normal users will no longer see it. These is no longer a need to pile on down votes and close votes.
  • Make it clear to the author of their post that it has been moved from the main site with the standard close reason messages. The OP can still view their own post even if it now sits in the "post feedback" area, regardless of what privileges they have.
  • Optionally reset all up/down votes on the post at this stage, since it has been removed and down votes no longer fill a purpose.
  • Feedback is given in comments as usual, but now only by people actually interested in helping.
  • Once the post has been edited into shape by the OP, a copy of the improved question can be restored to the main site by the same users/mods that had the privileges to remove it.
  • All the feedback & comments that were left about how to improve the post naturally stay in the "post feedback" area. They should remain semi-private and they shouldn't clutter up the actual question either.
  • If the post can't be salvaged or in case the OP isn't responsive, it stays closed and away from the main site.
  • Some automated cleaning of everything in the "post feedback" area could kick in after a certain time period (1 month?)

Down-voting is a recurring "hot potato" that we've discussed several times. With this system it becomes less prominent. But this is not a thread to discuss if we should have up/down votes or not.


What if there are conflicts anyway?

Disagreements of moderator/trusted user actions may be filed to the Arbitration & Review Panel. If so we might need some "severity grading" system depending on how serious every such issue is.

Serious issues like moderators or staff abusing their rights, breaking CoC and similar may require a more formal procedure along what's discussed in the draft at that link.

Minor issues such as "I disagree with close votes", "why were my comments deleted" could perhaps be handled with a smoother procedure, not necessarily involving the panel members but perhaps as well by neutral moderators.

Someone neutral just needs to hear out all involved parties and then make a decision, which probably just boils down to moving/keeping the post where it is, restoring deleted content or whatever may be the outcome.

I think it's important that moderators don't feel like they have to be on trial every time some disgruntled newbie disagree with them. But hopefully the above proposed system will reduce the number of such issues in the first place.

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.
Why should this post be closed?

1 comment thread

General comments (10 comments)
Post
+9
−0

I'd like to propose a different way of thinking about the problem (and I agree there are problems here).

Some premises:

  • New users don't know how things work, so we need to keep it simple.

  • Many non-veteran users are deterred by bad "people" experiences -- if your question is off-topic then ok no harm, but if people leave comments, especially public ones, that you read as criticizing you, that feels bad. Prevention is better than cleanup, because first impressions matter.

  • Many engaged community members want to lend a helping hand, but don't want to do redundant work or be part of a pile-on. Posters also don't want to be on the receiving end of an unintended pile-on ("this is the 27th person who's privately told me that"). If feedback is private, some sort of status information still needs to be public, like "3 users have given private feedback in the last 24 hours".

  • Not all users want to receive private feedback; some would prefer everything be public. (This has already been demonstrated in a comment.) People shouldn't be required to engage in private discussions.

  • People giving private feedback benefit by being able to work together. We've seen enough "joint debugging" in comment threads to know this. Private does not mean 1:1.

I envision a system where, by default, a new post gets a "private-ish feedback" thread (after we have threaded comments). A poster can turn it off, by post or as a user preference. For a post that has this thread, people with some ability to be determined (to keep out drive-by trolls) can see the thread and participate. Other people can see that the thread exists -- something conveying that private discussion is happening already.

For questions, the asker should be able to directly put the question on hold while addressing feedback. (If the owner alone put it on hold, then the owner alone can reopen it -- otherwise people won't do it.)

The question isn't hidden or relocated; that'd be more confusing than helpful, I think. I'd like to think that the combination of it being on hold and the visible presence of private feedback would be enough to signal to other community members "we're working on this; be back later". "Regular" comments wouldn't be affected; this is about adding one special thread, not removing anything else.

There are a lot of details to work out were we to take this approach, but I want to get feedback on the high-level idea before tackling them. Thoughts?

History
Why does this post require attention from curators or moderators?
You might want to add some details to your flag.

1 comment thread

General comments (7 comments)
General comments
r~~‭ wrote over 3 years ago

Can you clarify what ‘regular’ comments are for, in this vision? What's left that isn't a separate answer, isn't a proposed edit, and isn't feedback?

hkotsubo‭ wrote over 3 years ago

Regarding "New users don't know how things work", I think that the system itself could provide ways of guiding those users. Example: the Ask Question page could be like a "wizard" that instructs the OP to check that the question conforms to whatever the site considers on-topic ("Have you checked that [list of requirements]?"). Of course keeping it simple, but the idea is to prevent people from asking off-topic questions, instead of allowing and trying to fix it later

hkotsubo‭ wrote over 3 years ago · edited over 3 years ago

On smaller communities, it might be feasible to rely on community members to help every single new user to fix their questions, but as the site grows, it becomes utterly impossible to give personal assistance to all. Making the system do the heavy work, and prevent the problem before it happens (at least in most cases), is a much better solution, IMO. Don't get me wrong, I think your private-ish feedback proposal is a good idea, but it should serve to handle exceptions, and not to be the rule.

Monica Cellio‭ wrote over 3 years ago

@hkotsubo‭ better contextual guidance is one of our goals, yes. We're not there yet, but it's a design goal.

Monica Cellio‭ wrote over 3 years ago

@ r~~‭ links to related information, starting points for investigation (not an answer but maybe building blocks for an answer), comments/questions that are more tangential but still might be of interest (e.g. did you know there's a new version of that library that solves this problem?). These are things that are of public interest and aren't just for the OP.

Lundin‭ wrote over 3 years ago

Ideally some "Ask a question wizard" will prevent as much bad questions as possible before they even hit the site, but they won't catch everything. "New users don't know how things work, so we need to keep it simple." They'll receive the same notification as with the current system, but saying that the question was moved from the main site instead of "closed", which nobody including many veterans actually knows what it means.

Lundin‭ wrote over 3 years ago

If they don't want to listen to feedback from there on, fine, we can hide the feedback thread so that you have to click somewhere to open it and add an opt-out. To avoid the "pile-on" problem all user feedback should be visible to other users with the same privilege that are willing to help, but not to the broad masses who are not willing to help.