Content contributors, statistical analysis Options

[Peter Damian]

I have a feeling that you might want to break down where exactly the people are editing. Perhaps a much better way of determining "content" contributors are those who add large amounts of bytes to an article that aren't part of an undo? (It would be hard to remove all of the undos though).

It all depends what you want to prove. I am trying simply to see if there is a simple statistical measure that suggests, with some degree of confidence, that there is a division of labour between 'content contributors' and 'gnomes'. We all know anecdotally that this exists, but here is an objective measure. The fact that the measure, like all statistical measures, only shows this with a certain degree of confidence, but no absolute certainty, does not matter. To be sure, some people we think of as content contributors have gnome-like characteristics (e.g. YellowMonkey). But we know that too, from his edits, when he was active.

The other point is that low epp count is indicative of low-value added - monotonous, easily learned repetitive labour.

The final point is that this low-value labour gives you high status on Wikipedia, unlike in the real world.

[Peter Damian]

As I mention above, after seeing Jechoman's epp (7.46) I disagree with the third sentence of 1, though I'm not sure how indicative this is on average. Basically you DO have to control somehow for % of edits to actual articles vs. other categories of Wikipedia pages.

I looked at his edits and he has a large percentage of 'blue' (Wikipedia: pages) which suggests he is part of the peanut gallery. I'm not disagreeing - it's an 'in general' thing. I looked at 720 admin editors and tried in each case of > 4 to explain why it was higher. In nearly all cases the person has a hobby of caterpillars or asteroids, or has FA and GA stars. In most cases of <4, this is not the case. In nearly every case of < 2 the person either is a bot, or acts like one.

Interesting that David Gerard got the second lowest score, I should have mentioned that earlier :|

Edit: or as another counter example take Baseball Bugs. His epp is 10.63. But we all know that's only because he just edits AN/I more or less. Yet a simple measure such as yours would put him in a category of "content creator"

Agree again. With all statistical measures, we see if there is broad agreement, look for anomalies, then try and explain them.

I will do this study again some time, but using the tool to check 720 edits take exactly 2 days. Access to the database would be wonderful.

This post has been edited by Peter Damian: Sun 30th October 2011, 9:34pm

[radek]

As I mention above, after seeing Jechoman's epp (7.46) I disagree with the third sentence of 1, though I'm not sure how indicative this is on average. Basically you DO have to control somehow for % of edits to actual articles vs. other categories of Wikipedia pages.

I looked at his edits and he has a large percentage of 'blue' (Wikipedia: pages) which suggests he is part of the peanut gallery. I'm not disagreeing - it's an 'in general' thing. I looked at 720 admin editors and tried in each case of > 4 to explain why it was higher. In nearly all cases the person has a hobby of caterpillars or asteroids, or has FA and GA stars. In most cases of <4, this is not the case. In nearly every case of < 2 the person either is a bot, or acts like one.

Interesting that David Gerard got the second lowest score, I should have mentioned that earlier :|

Edit: or as another counter example take Baseball Bugs. His epp is 10.63. But we all know that's only because he just edits AN/I more or less. Yet a simple measure such as yours would put him in a category of "content creator"

Agree again. With all statistical measures, we see if there is broad agreement, look for anomalies, then try and explain them.

I will do this study again some time, but using the tool to check 720 edits take exactly 2 days. Access to the database would be wonderful.

I think you have uncovered a certain asymmetric pattern here: low epp --> "gnomish edits" or "useless crap" but certainly not "content". Hi epp --> it depends.

I brought up the counter examples above simply because I'm wondering how much of the pattern that is and if it could somehow be controlled for. High % "blue pages" and % "user's talk" I think would be good indicators that a particular editor with a high epp is in the "peanut gallery" category, not the "content creator" category

This post has been edited by radek: Sun 30th October 2011, 9:37pm

[Peter Damian]

For the record, here are the top 20 scorers. Most of them are consistent with the hypothesis. Even FT2, whose top articles were Zoophilia, Labrador Retriever and Neurolinguistic Programming.

Marine 69-71 is Tony the Marine.

Zero0000 7.28
Maunus 7.36
Jmh649 7.38
Jehochman 7.46
Happyme22 7.77
AnemoneProjectors 7.87
Cailil 7.97
Masem 8.05
Mike Cline 8.23
Stephan Schulz 8.28
Cbl62 9.05
Gatoclass 9.2
FT2 9.27
Gwen Gale 9.27
SlimVirgin 9.4
Slrubenstein 9.66
COGDEN 9.67
Marine 69-71 10.08
Moni3 12.72
Wehwalt 20.51

[Peter Damian]

I think you have uncovered a certain asymmetric pattern here: low epp --> "gnomish edits" or "useless crap" but certainly not "content". Hi epp --> it depends.

It does depend, but if you look at the actual top 20, with very few exceptions, they don't edit 'blue pages'. Hochman is the only one, I think.

Could it or should it be controlled? Only if it occurs significantly across much of the sample. Here, I think we can note it and pass one.

The anomalies are actually in the 2-3 region where content contributors also engage in regular frenetic 'gnoming'.

On Baseball Bugs, I did another study a few months ago of edits over 2 years to ANI. He came out way ahead of anyone else and is, again, probably an anomaly.

This post has been edited by Peter Damian: Sun 30th October 2011, 9:47pm

[communicat]

PeterEdward, in my experience there's another category of wikipedian apart from admins with low-value skills and actual 'content contributors'. I'm referring of course to the category of "supervisor", namely the fact that for every content contributor there seem to be at least three or four extremely tedious and irritating "supervisors", not necessarily admins or productive editors, who constantly nit-pick and tell the content contributor how they think the edit should be done or what should or should not be included. Needless to say, these "supervisors" never, but never, make any edits or content contributions of their own. (Possibly because they already know from some past experience how much shit they'd have to put up with if ever they did try to make a useful contribution).

Isn't this similar to the way the Red Army used to have 'political officers'?

I see no convincing comparison or correlation between the Red Army's political commissars and WP's self-appointed supervisors. But if it's correlations you're after, try the one that exists between the decline of the American-dominated WP and the decline of the American economy -- (not to mention the decline in American international prestige following its disasterous interventions in Iraq and Afghanistan, and the disaster that's sure to follow in newly "liberated" Libya). Very few people outside of America attach much credibility these days to anything perceived to be American or American-based, (including even or especially WP).

[Peter Damian]

I see no convincing comparison or correlation between the Red Army's political commissars and WP's self-appointed supervisors.

That reminds me of another study I need to complete. I was looking at regularly blocked content creators such as Malleus, Giano and, er, myself.

There was a regular pattern of one admin blocks for some supposed offence, and then another admin unblocks. You can easily put this into a table with 'block' on one side and 'unblock' on another.

Now, if we were to plot the binary block/unblock against epp, what would we get, I wonder?

Suggestions or guesses please.

[radek]

I think you have uncovered a certain asymmetric pattern here: low epp --> "gnomish edits" or "useless crap" but certainly not "content". Hi epp --> it depends.

It does depend, but if you look at the actual top 20, with very few exceptions, they don't edit 'blue pages'. Hochman is the only one, I think.

Could it or should it be controlled? Only if it occurs significantly across much of the sample. Here, I think we can note it and pass one.

The anomalies are actually in the 2-3 region where content contributors also engage in regular frenetic 'gnoming'.

On Baseball Bugs, I did another study a few months ago of edits over 2 years to ANI. He came out way ahead of anyone else and is, again, probably an anomaly.

Well, the other one that you should include is "purple" pages (User talk). But yes, there is some patterns here.

Here, I made a matrix (and uploaded it to commons ) which I think sort of describes what is going on, though obviously we haven't got the data to confirm ALL the cells in it:



You could graph some "famous" editors on that matrix like in those libertarian "economics/social values" graphs people put on their userpages. I expect that'd be pretty funny AND informative.

(and on that note, I'm sort of wondering if there's a way to randomly sample editors (say, those with more than 1000 edits) in a way similar to the Random Article feature)

This post has been edited by radek: Sun 30th October 2011, 10:04pm

[Peter Damian]

I think you have uncovered a certain asymmetric pattern here: low epp --> "gnomish edits" or "useless crap" but certainly not "content". Hi epp --> it depends.

It does depend, but if you look at the actual top 20, with very few exceptions, they don't edit 'blue pages'. Hochman is the only one, I think.

Could it or should it be controlled? Only if it occurs significantly across much of the sample. Here, I think we can note it and pass one.

The anomalies are actually in the 2-3 region where content contributors also engage in regular frenetic 'gnoming'.

On Baseball Bugs, I did another study a few months ago of edits over 2 years to ANI. He came out way ahead of anyone else and is, again, probably an anomaly.

Well, the other one that you should include is "purple" pages (User talk). But yes, there is some patterns here.

Here, I made a matrix (and uploaded it to commons ) which I think sort of describes what is going on, though obviously we haven't got the data to confirm ALL the cells in it:



You could graph some "famous" editors on that matrix like in those libertarian "economics/social values" graphs people put on their userpages. I expect that'd be pretty funny AND informative.

I think that hits the nail on the head.

However, under 'content creators' there is a further subdivision into those who create long and boring articles sourced from weather and hurricane reports, or articles about video games, and those who don't.

There's very little remainder, actually.

[radek]

I think you have uncovered a certain asymmetric pattern here: low epp --> "gnomish edits" or "useless crap" but certainly not "content". Hi epp --> it depends.

It does depend, but if you look at the actual top 20, with very few exceptions, they don't edit 'blue pages'. Hochman is the only one, I think.

Could it or should it be controlled? Only if it occurs significantly across much of the sample. Here, I think we can note it and pass one.

The anomalies are actually in the 2-3 region where content contributors also engage in regular frenetic 'gnoming'.

On Baseball Bugs, I did another study a few months ago of edits over 2 years to ANI. He came out way ahead of anyone else and is, again, probably an anomaly.

Well, the other one that you should include is "purple" pages (User talk). But yes, there is some patterns here.

Here, I made a matrix (and uploaded it to commons ) which I think sort of describes what is going on, though obviously we haven't got the data to confirm ALL the cells in it:



You could graph some "famous" editors on that matrix like in those libertarian "economics/social values" graphs people put on their userpages. I expect that'd be pretty funny AND informative.

I think that hits the nail on the head.

However, under 'content creators' there is a further subdivision into those who create long and boring articles sourced from weather and hurricane reports, or articles about video games, and those who don't.

There's very little remainder, actually.

Looking at some editors epps and %s, an allowance should be made for people who run certain projects. For example both Gatoclass and SandyGeorgia would show up in the "Drama Queens" category. They have high epps because they post a lot to the same project page (DYKs and GAs) and low % article space counts for the very same reason (or because they post to user talk to notify people that their articles are being reviewed/approved etc.)

[Ottava]

Here, I made a matrix (and uploaded it to commons ) which I think sort of describes what is going on, though obviously we haven't got the data to confirm ALL the cells in it:



You could graph some "famous" editors on that matrix like in those libertarian "economics/social values" graphs people put on their userpages. I expect that'd be pretty funny AND informative.

(and on that note, I'm sort of wondering if there's a way to randomly sample editors (say, those with more than 1000 edits) in a way similar to the Random Article feature)

My percentage in Articles was less than 30%. I still think you are forgetting WP:DYK, WP:GAN, WP:FAC, which moves edits from "article" or "article talk" to Wikipedia. Nevermind, you mentioned that in your next post.

By the way, Gatoclass writes very little actual content. He is just an admin that latched onto DYK and used it as his little territory. SandyGeorgia does some article work but very little anymore.

This post has been edited by Ottava: Sun 30th October 2011, 10:53pm

[radek]

Here, I made a matrix (and uploaded it to commons ) which I think sort of describes what is going on, though obviously we haven't got the data to confirm ALL the cells in it:



You could graph some "famous" editors on that matrix like in those libertarian "economics/social values" graphs people put on their userpages. I expect that'd be pretty funny AND informative.

(and on that note, I'm sort of wondering if there's a way to randomly sample editors (say, those with more than 1000 edits) in a way similar to the Random Article feature)

My percentage in Articles was less than 30%. I still think you are forgetting WP:DYK, WP:GAN, WP:FAC, which moves edits from "article" or "article talk" to Wikipedia. Nevermind, you mentioned that in your next post.

By the way, Gatoclass writes very little actual content. He is just an admin that latched onto DYK and used it as his little territory. SandyGeorgia does some article work but very little anymore.

You are, for once, right on this. I'm actually taking down some of this data for various people and you come up as a "Someone who uses Wikipedia as Facebook" but I don't think you were that - well, not that much - correction, you come up as "Drama Queen"... hmm, maybe not that far off. This is actually very similar to the problem that someone like SandyGeorgia comes up as indistinguishable along these two dimensions from someone like Baseball Bugs. And all of that has to do with the fact that the soxred data does not distinguish between "Posting to AN/I way too much" from "Reviewing GAs and FAs" - it counts both under "Wikipedia" but qualitatively these are very different things.

So... I'm still tweaking it. If anyone can point me to a statistic which would allow me to distinguish "Posting to ANI way too much" from "Reviewing GAs" (or similar) kind of people then I would appreciate it. For some editors who "opted in" into the whole soxred thing you can do it, but most haven't. Other than that, the only thing I can think of is to take an editor's last 1000 or so contributions and see what % were to ANI, AE etc. But that's a buttload of work at this point.

BTW, Malleus is a very clear outlier. Very high % in article space and pretty high % epp. Very clearly a "content contributor". Giano not so much (though still in that cell).

Update:

Here's a bit of what I have so far:



Again, the basic problem is that given the data, in the "warm colors" category (red and orange) it is impossible to distinguish people who use WP:whatever type pages (the blue pages) for what could essentially be considered legitimate uses (reviewing FAs etc.) vs. people who are fucking around (playing on ANI, politicking on talk pages)

Also, related to the other thread, someone like Dr. Blofeld shows up as a "wiki gnome" because they mass create a lot of one or two sentence stubs. This means their article % is high, but since he never goes back to see what happened to the children he sired he has a low epp. In this case I think "wiki gnome" is not too inaccurate (cough cough), so I'm not bothered by this. Overall I think this illustrates some of the above discussion.

This post has been edited by radek: Sun 30th October 2011, 11:44pm

[EricBarbour]

For example, Fetchcommons has 28.26% of his posts to user's talk. Sandstein has 24.71%. SarekOfVulcan has 24.09%, Jechochman (who has a pretty high average edits per page - but that's not cause he edits articles a lot) 28.93%, Georgewilliamherbert 34.69% BWilkins 39.26% etc.

All of whom are notoriously contentious and abusive admins.
And none of whom adds very much in article content.

This chart is actually not bad, although there are some exceptions (but not very many).
Bear in mind that many of those "wiki gnomes" are heavy users of bots that scrape
from other websites. I would call them something more descriptive, like "Benders".
(That's because Futurama is an extremely popular subject among WP admins....)


This post has been edited by EricBarbour: Sun 30th October 2011, 11:32pm

[radek]

Bear in mind that many of those "wiki gnomes" are heavy users of bots that scrape
from other websites. I would call them something more descriptive, like "Benders".

Yes, very much so, as the chart right above illustrates. Here's where you get into semantics - mass creating a bunch of next-to-useless stubs is "gnomish" so the category is appropriate, just not refined enough. I do wish that I could somehow just a get a huge data dump on all active (more than 100 edits per month) editors, to see what the relative supply of each kind is.

[EricBarbour]

However, under 'content creators' there is a further subdivision into those who create long and boring articles sourced from weather and hurricane reports, or articles about video games, and those who don't.

Yes, there is a reasonably clear division between obsessives and people who write on varied
article subjects. The real obsessives have truly disturbing contribs. Like the several guys who
can't stop talking about hurricanes, or the Doctor Who nerds.

This is why Jimbo's old comment that he "didn't want bias" from obsessive editors is so pathetic.
Because that's exactly what he's got. In spades.

This post has been edited by EricBarbour: Sun 30th October 2011, 11:39pm

[timbo]

Radek's Chart really nails it.

Silver seren makes a good point that some excellent content creators probably write outside of mainspace and then transfer everything at once. So there would be substantial content creation with minimal edits per page in this situation. I suppose a really scientific study would somehow include kilobytes of content incorporated into the first edit of a newly created page and weigh that into the equation.

Myself, I like to build a framework, write a lead, add a couple lines to subsections and a source or two to keep the wolves at bay, and then to do the writing in mainspace.

As to the question why gnomish administrative sorts have high status and content creators low status, that's an ongoing sore spot with me. I think that part of it is to be corrected by simple consciousness raising among those who write. Speaking for myself, I felt somehow vindicated or rewarded or whatever the term is when I was given autoreviewed status -- so that new articles come through the front gate without being highlighted in yellow and therefore tampered with by gnomish administrative sorts for no good reason.

The New Articles spooler is akin to a shark tank sometimes, some of those reviewing new work are only semi-competent, working too fast, meddling too much. Obviously, there's a lot of swill rolling through the door that needs to be stopped, but it's still a source of annoyance to just get started and then have a series of edit conflicts with meddlesome new page patrollers.

My prescription for WP would be to have autoreviewed status made into a bigger deal as a mechanism for rewarding content creators.

I also wouldn't mind the gnomish sorts being taken down a peg by renaming "administrators" as "janitors." That would balance the field. But that's pettiness on my part, I suppose, owing to an aversion to people of that personality type and their clique mentality...

I think there are some administrative tools that would be useful for content creators. Being able to see deleted files would be a boon now and then -- but that ultimately is a pretty minor tidbit in the big scheme of things; certainly nothing worth undergoing the Lord of the Flies gauntlet of THOSE people.

tim

This post has been edited by timbo: Mon 31st October 2011, 2:12am

[radek]

That chart really nails it.

Silver seren makes a good point that some excellent content creators probably write outside of mainspace and then transfer everything at once. So there would be substantial content creation with minimal edits per page in this situation. I suppose a really scientific study would somehow include kilobytes of content incorporated into the first edit of a newly created page and weigh that into the equation.

Myself, I like to build a framework, write a lead, add a couple lines to subsections and a source or two to keep the wolves at bay, and then to do the writing in mainspace.

As to the question why gnomish administrative sorts have high status and content creators low status, that's an ongoing sore spot with me. I think that part of it is to be corrected by simple consciousness raising among those who write. Speaking for myself, I felt somehow vindicated or rewarded or whatever the term is when I was given autoreviewed status -- so that new articles come through the front gate without being highlighted in yellow and therefore tampered with by gnomish administrative sorts for no good reason.

The New Articles spooler is akin to a shark tank sometimes, some of those reviewing new work are only semi-competent, working too fast, meddling too much. Obviously, there's a lot of swill rolling through the door that needs to be stopped, but it's still a source of annoyance to just get started and then have a series of edit conflicts with meddlesome new page patrollers.

My prescription for WP would be to have autoreviewed status made into a bigger deal as a mechanism for rewarding content creators.

I also wouldn't mind the gnomish sorts being taken down a peg by renaming "administrators" as "janitors." That would balance the field. But that's pettiness on my part, I suppose, owing to an aversion to people of that personality type and their clique mentality...

I think there are some administrative tools that would be useful for content creators. Being able to see deleted files would be a boon now and then -- but that ultimately is a pretty minor tidbit in the big scheme of things; certainly nothing worth undergoing the Lord of the Flies gauntlet of THOSE people.

tim

In case you're wondering you're in the "Wiki Gnome" category. Which, perhaps, just goes to show, that the above chart is about the TYPE of contributions and not really about the QUALITY of such - in my mind it's useful to get the TYPE distribution down first. I mean, some AN/I commentatin' might actually be "of quality" or something. But I don't really know you so it could be quality.

Second, the "autoreviewer" thing is a joke. Anyone who has managed to make a few edits without getting blocked as a vandal can get it. They throw these bones to you to make you think you're "important". You're not. (Neither am I)

[timbo]

For example, Fetchcommons has 28.26% of his posts to user's talk. Sandstein has 24.71%. SarekOfVulcan has 24.09%, Jechochman (who has a pretty high average edits per page - but that's not cause he edits articles a lot) 28.93%, Georgewilliamherbert 34.69% BWilkins 39.26% etc.

All of whom are notoriously contentious and abusive admins. ***

I noticed Sarek's name on the Resigned Administrators list today. I've bumped bellies with him in the past once or twice... I don't think he's a bad person, just not temperamentally suited for power tools, in my estimation. I think maybe he has come to the same conclusion.

Here's hoping he has second wind as a content creator...

tim

[timbo]

Second, the "autoreviewer" thing is a joke. Anyone who has managed to make a few edits without getting blocked as a vandal can get it. They throw these bones to you to make you think you're "important". You're not. (Neither am I)

It made my life easier and less stressful and I value it.

Everybody is important and nobody is important. Getting some acknowledgement that one's work is noticed by others is good. Give a cowardly lion a medal and it makes him courageous.


tim

[Peter Damian]

A message to me from a Wikipedian.

I wish you all the best, and look forward to the book, but hope you realise you have a blind spot, and that you do not bend the statistic you gather to reinforce what you already beieve. I think you are a good guy, have always though that, but you've been through the wars here, dont let it affect your critical distance as it will inevitably be used against you. Feel free to talk to me anytime, I have the same facination. Youd be surprised how many of us think similar to you, but more critically and with more self awareness. Still, best. Ceoil (talk) 01:38, 31 October 2011 (UTC)

OK I need to develop this ‘critical awareness’ about Wikipedia. Can anyone help me here?