Welcome to Codidact Meta!
Codidact Meta is the meta-discussion site for the Codidact community network and the Codidact software. Whether you have bug reports or feature requests, support questions or rule discussions that touch the whole network – this is the site for you.
What criteria are used to determine to launch a new community?
Codidact currently has several communities (with varying levels of activity), and several more proposals for new communities. There seems to be an effort in many of these proposals to collect users to ensure that there's enough interest before launching a new site. This makes sense, because an empty site without participants (especially expert answerers) isn't particularly helpful to anyone.
But how much interest is "enough" interest? Are there some objective (or even subjective) criteria that need to be met in terms of number of "signed-up" users, number of moderators, how many upvotes the proposal gets, or scope definition completeness before a site is launched?
Or in short, what's the process from proposal to actual launch look like in terms of how the decision to launch gets made?
I'm speaking only for myself here. Unfortunately, we're still kind of winging this, and learning as we go. We now re …
4y ago
It seems that two things are required for a new site to be successful: A core group of domain experts that commit to …
4y ago
I think this answer by @laserkittens to a community proposal is very interesting. It does not just keep track over how m …
4y ago
3 answers
It seems that two things are required for a new site to be successful:
- A core group of domain experts that commit to being around to answer questions, and initially, to do the housekeeping.
- Getting the word out. Somehow those people with questions need to know to ask here.
I think 3 committed domain experts is enough for launching a site. That's the relatively easy criterion to meet. The experts in any domain are well known, so you simply reach out to them and invite them. Some will already be somewhere else, aren't comfortable with the whole concept, or just don't want to take on an additional commitment. You keep going until you get at least three.
Note that this reaching out doesn't have to be done by a domain expert. Either way, the result is well measurable. Either there are 3 people that have said they'll be around to answer questions and provide content, or there aren't. Don't launch until there are.
Getting the word out is much more difficult. I don't have ready answers how to do it, nor how to measure whether it is likely to get done. Getting the word out can't be properly done until there is a site, so the decision to launch has to be made on whether there is a believable plan.
I don't have a good answer to what constitutes a believable plan. For now, we probably need the core group of site proposers to present a plan, then we'll wing it on whether it sounds good enough or not. This will likely include some back and forth negotiation. In the long run, we will hopefully learn what works and what doesn't.
It would also be instructive to look at the two issues above in retrospect for each site, together with some evaluation of how well the sites have taken off. I think some patterns will be apparent.
Not counting Meta, we have run 10 different experiments already. It's time to gather the data and see what it tells us.
Real data, 30 Oct 2020
To get at least some measure of how successful each site currently is, I looked at the non-meta activity in the last month. I counted all the post in a category where the system showed the last activity being less than "1 month ago". I then added up the result for all non-meta catagories for each site:
Software Development 79, 6 85 Judaism 27, 5, 9 41 Electrical Enginnering 25, 1 26 Languages 15, 3 18 Math 14 14 Cooking 5, 2, 2 9 Outdoors 4, 1, 1 6 Photography 2, 1, 1 4 Writing 3, 0 3 Scientific Speculation 1, 0 1
The first sets of numbers are the number of posts within each individual category. The last number is the total of the others. I used that total to make a quick visual representation of relative site activity:
SW XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX Jud XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX EE XXXXXXXXXXXXXXXXXXXXX Lang XXXXXXXXXXXXXXX Math XXXXXXXXXXXX Cook XXXXXXX OutD XXXXX Phot XXX Writ XX ScSp X
So what does this tell us?
- There is no clear cutoff between active and dead sites. We seem to have a continuum.
- The more recently launched sites are generally doing OK.
- The bottom four (maybe 5) sites have in common that there is no group of domain experts committed to the site.
- The top four (maybe 5) sites have in common that there is a group of domain experts committed to the site.
I'm speaking only for myself here.
Unfortunately, we're still kind of winging this, and learning as we go. We now realize we launched some early communities without enough active, engaged members, but we don't know where that sweet spot is yet. We don't want to hinder communities, and we also don't want to set them up for failure. Early on we were paying too much attention to votes on proposals, without asking whether those votes meant "I'm interested" or "that sounds like a good idea". This is why I started adding the posts asking people to indicate their interest.
One thing that I've come to realize makes a difference is velocity. Our Judaism community gathered support quickly and launched within days, which meant the community could continue that momentum. The proposers of our Electrical Engineering community came to us as a group of interested experts and, similarly, we launched within days. Early on I thought the RPG community would take off, but it's been waiting for a while without much activity and I don't know if the original supporters are still interested. We have a new proposal for Christianity and a recently-revitalized one for Code Golf, both of which also seem to have active supporters. (Christianity only has a couple who've said they're enthusiastic; I'd feel more comfortable with more.) With the momentum that Code Golf has, I'd be happy to launch it soon -- we're actually blocked on a technical matter, not the community (aside from the matter of a name).
We've been launching communities with "enough 'starter' scope" with the assumption that communities would then refine that scope as questions come up. On Software Development we've gotten some pushback that we were too vague to start. That might be due to the unusual way this community got created, though.
I am very interested in hearing feedback on how to do this better! We want to help communities build homes for themselves here. Some will do it more quickly and some more slowly, some with broader scope (encouraging more questions) and some with narrower scope (more specialized). If the community isn't there (or doesn't stick around because there's not enough activity), we aren't serving them well. If we place too many hurdles before launching communities, we aren't serving them well. We're aiming for balance, learning from each community we launch, and doing some guessing. I'm sorry; I wish I had a better answer.
I think this answer by @laserkittens to a community proposal is very interesting. It does not just keep track over how many that are interested, but also a qualified guess over how active the users will be, if they are potential mod material and so on.
This is something that a user cooked up themselves without site support, but couldn't we do something similar for all communities? Optionally with site support. Then over time/with experience come up with some metric over how many "active", "casual" and "mod" etc candidates there should be.
If this was integrated in the site, then specific users could "age away" from active to inactive in case they haven't participated in any community or meta for a while, so the data gathered would still be valid some months later, after the initial community proposal. Maybe make it so that a user on the list could "bump" their name "yes I'm still interested" etc.
1 comment thread