Page MenuHomePhabricator

Add new Analytics components (Webstatscollector), move "Wikimedia Statistics" into product "Analytics"
Closed, ResolvedPublic

Description

Please add the following components under the 'Analytics' product:

  • Wikistats
  • Webstatscollector
  • Statistics

Ty

Diederik


Version: wmf-deployment
Severity: normal

Details

Reference
bz42088

Event Timeline

bzimport raised the priority of this task from to High.Nov 22 2014, 1:03 AM
bzimport set Reference to bz42088.

(In reply to comment #0)

Please add the following components under the 'Analytics' product:

  • Wikistats

How is this different from Wikimedia>Statistics?

  • Webstatscollector
  • Statistics

Maybe you also/rather need a General/Unknown or [other]?

Plus component *descriptions* are required, preferably with URLs where I can see these components in action. :)

Wikimedia -> Statistics is a container category of stats issues with Mediawiki, stats.wikimedia.org and it's hard to find. The Analytics Team is responsible for stats related issues so let's make it easy to find and put it under Analytics.

I think Statistics should be our equivalent of General /Unknown.

  • Wikistats

All issues regarding stats.wikimedia.org

  • Webstatscollector

All issues regarding dumps.wikimedia.org/other/pageviews/

  • Statistics

The equivalent of General / Unknown

Could you live with it being "Wikimedia Stats" for "stats.wikimedia.org" because i already have "Wikistats" as a component in Labs for a while for all things regarding "wikistats.wmflabs.org" which was going to move to be wikistats.wikimedia.org. Diederik, arr, sorry, this is what i meant with the naming conflict. I should have replied again weeks ago :P. I already put "Wikistats" in tons of places months ago, always expecting that "stats.wikimedia.org" is just "stats" or "wikimedia stats". Maybe we can talk again?

Well, wikistats (stats.wikimedia.org) has existed for almost 10 years and the entire community uses wikistats to refer to stats.wikimedia.org so yes it's really too bad that you didn't respond :(

Sorry to make this even more complicated...

(In reply to comment #4)

  • Webstatscollector

All issues regarding dumps.wikimedia.org/other/pageviews/

Reports about dumps.wikimedia.org stuff so far seem to have been filed in the Bugzilla product "Datasets". If this setup is kept, any idea for criteria how bug reporters can distinguish? Or shall we end up with renaming the "Analytics" product to "Analytics and Datasets" and make Datasets a component under this product (not too hard as Datasets does not have subcomponents currently, except that moving would trigger 135 bugmails)? Or any other idea / prefered plan?

Yes, please move Datasets to Analytics as well. I am okay with renaming Analytics to Analytics & Datasets. We are the principal caretaker of the datasets as well. And a separate Datasets component sounds good as well

What's the point of moving dump related bugs to a sub-component of analytics? They're not really related as far as the code base goes.

(In reply to comment #6)

Well, wikistats (stats.wikimedia.org) has existed for almost 10 years

I'm not sure Erik's WikiStats came so much before Daniel's http://s23.org/wikistats/ , but not worth discussing. ;-)

and the
entire community uses wikistats to refer to stats.wikimedia.org so yes it's
really too bad that you didn't respond :(

However, it's also just [[stats:]] (interwiki) or Statistics, so WikiStats vs. Statistics is very confusing. Plus, you have dozens of repositories with very mysterious-sounding names, so a General/Unknown component would be very useful to avoid dozens of components and for people who don't know all the details. :-)

(In reply to comment #9)

What's the point of moving dump related bugs to a sub-component of analytics?
They're not really related as far as the code base goes.

I'll leave that to Diederik. Current proposal ("Datasets" product, and new "Analytics/Webstatscollector" component) would split dumps.wm issues among two Bugzilla products. I only would like to make sure that *reporters* can find their way to the right place in Bugzilla when it comes to dumps.wm.org related issues. How this is done in the end, I don't mind.

What's blocking me to proceed here is that it really would not be clear where to report issues about dumps.wikimedia.org.
If you could agree on something / if Diederik could live with two products ("Datasets" for anything related to dumps.wikimedia.org and Analytics for anything else, if I get it right?) I could proceed.

I am fine either way, dumps.wikimedia.org can be a component under datasets or analytics. Let's just wrap this up and move along.

fine, I just don't want people reporting dumps bugs to have to hunt around under analytics. go for it.

Done:

  • Analytics
    • Wikistats (created) - All issues regarding stats.wikimedia.org
      • Move "Wikimedia -> Statistics" here (63 bug reports)
    • General/Unknown (created) - Any other statistics issues that you could not find a better place for.
      • Add hint to Wikimedia product where to find it now.
    • gerrit-stats (existed already)
    • ReportCard (existed already)
  • Datasets
    • General / Unknown (existed already, all issues about dumps.wikimedia.org except for DumpHTML and Webstatscollector)
    • Webstatscollector (created) - All issues regarding dumps.wikimedia.org/other/pageviews/

I've seen some reports about Special:Statistics not working properly dumped under Wikimedia->Statistics (now Analytics->Wikistats).
Is that out of scope? Should rather be under "MediaWiki->Special pages"?

Yeah that's completely unrelated (in reality, though perhaps not in the user's mind). I guess SpecialPages is the place for that so the right folks will see it. Hmm I'm curious about the bug too, feel free to add me while you're moving things around...

Yes Special Pages should go to MediaWiki.

(In reply to comment #16)

Yeah that's completely unrelated (in reality, though perhaps not in the user's
mind). I guess SpecialPages is the place for that so the right folks will see
it. Hmm I'm curious about the bug too, feel free to add me while you're moving
things around...

They're usually not real bugs, rather changes in the wiki content not reflected in the stats cache, fixed by running updateArticleCount.php. I moved them to site requests; the bugs on the actual counting method are already under MediaWiki.

I also moved to Webstatscollector the bugs on Domas' wikistats and other unrelated bugs to some other Wikimedia components.

Nemo: Big thanks for the help!