Page MenuHomePhabricator

Bugzilla data scanned for tech metrics must be aligned with repos scanned
Closed, ResolvedPublic

Description

Currently http://korma.wmflabs.org/browser/its-repos.html shows that the Bugzilla products scanned are MediaWiki, All extensions, VisualEditor and Parsoid. However, this list must be in sync with http://korma.wmflabs.org/browser/scm-repos.html - which in turn is synced with https://wikitech.wikimedia.org/wiki/Key_Wikimedia_software_projects

Let's update that wiki page with the relevant products / components. A 100% match is probably impossible, but a 90% (or so) should be feasible.


Version: unspecified
Severity: major
See Also:
https://bugzilla.wikimedia.org/show_bug.cgi?id=49744

Details

Reference
bz54469

Event Timeline

bzimport raised the priority of this task from to Medium.Nov 22 2014, 2:11 AM
bzimport set Reference to bz54469.

Álvaro, can MetricsGrimoire scan only specific components of a Bugzilla product? The reason to ask is that, ideally, we wouldn't scan the whole MediaWiki Extension product but only the relevant components.

Yes Quim, we can scan only components.

Quim, for the Bugzilla components mapping, do you have some plan in mind for gathering the info from Wikimedia Community? Maybe we can start doing the mapping of the more clear components, but it there is a complete process to cover all of them, much better!

(If there is something I can specifically help with as Bugzilla admin, please tell me what I need to do for you folks.)

Andre, if you could point to the Bugzilla product/component of each project at https://wikitech.wikimedia.org/wiki/Key_Wikimedia_software_projects that would be perfect!

I guess we all know that there are no clear 1:1 mapping is possible, but instead 1:n or n:1. I just hope to avoid n:n. :)

[[wikitech:Key_Wikimedia_software_projects]] -- Bugzilla product > component

Analytics

analytics/kraken -- Analytics > Kraken
analytics/webstatscollector -- Datasets > Webstatscollector
analytics/wikimetrics -- Analytics > Wikimetrics
analytics/wikistats -- Analytics > Wikistats
github.com/wikimedia/limn -- Analytics > Limn
analytics/* -- Analytics > General/Unknown

Mobile apps

apps/android/commons
github.com/wikimedia/Commons-iOS -- Commons App > iOS (iPhone or iPad)
github.com/wikimedia/WikipediaMobile -- Wikipedia App
github.com/wikimedia/WikipediaMobileFirefoxOS -- Wikipedia App
github.com/wikimedia/WLMMobile -- Wiki Loves Monuments > Mobile

Integration

  • -- Wikimedia > Continuous integration

Operations

Hard to define, mostly in rt.wikimedia.org, some in Bugzilla under "Wikimedia > General" with keyword "ops".
operations/dns -- Wikimedia > DNS
operations/software/otrs -- Wikimedia > OTRS

Wikimedia

Bugzilla

wikimedia/bugzilla/modifications -- Wikimedia > Bugzilla
wikimedia/bugzilla/triagescripts -- Wikimedia > Bugzilla
wikimedia/bugzilla/wikibugs -- Wikimedia > wikibugs IRC bot

Communication

wikimedia/communications/WMBlog -- Wikimedia > Blog

Fundraising

Mostly using CiviCRM; related components in Bugzilla are:

  • MediaWiki extensions > FundraiserLandingPage
  • MediaWiki extensions > FundraiserPortal
  • Wikimedia > Fundraising Misc.
  • Wikimedia > Fundraising Requirements

MediaWiki misc

mediawiki/php/FastStringSearch

mediawiki/php/NativePreprocessor
mediawiki/php/luasandbox     --  MediaWiki extensions > Scribunto
mediawiki/php/wikidiff2      --  MediaWiki extensions > wikidiff2

mediawiki/tools/code-utils -- Tools > code-utils
mediawiki/tools/mwdumper -- Tools > mw-dumper

Pywikibot

pywikibot/* -- Pywikibot > *

Other

mediawiki/vagrant -- MediaWiki-Vagrant > *
labs/toollabs -- Wikimedia Labs > tools
openzim -- openZIM > *
qa/browsertests -- Wikimedia > Quality Assurance

Core Extensions

Don't want to spend too much time going through the list and syncing with https://bugzilla.wikimedia.org/editcomponents.cgi?product=MediaWiki%20extensions however noteworthy naming differences from the top of my head:

PageTriage -- MediaWiki extensions > PageCuration
Parsoid -- Parsoid > *
SyntaxHighlight_GeSHi -- MediaWiki extensions > SyntaxHighlight (GeSHi)
VisualEditor -- VisualEditor > *
Wikibase -- MediaWiki extensions > WikidataRepo

Ok guys, is this ready to start downloading all those bugzilla product and components and adding them to the korma browser?

Great, I have programmed for adding to the report the next repos:

Analytics > Kraken: https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=kraken&list_id=243545
Datasets > Webstatscollector: https://bugzilla.wikimedia.org/buglist.cgi?product=datasets&component=Webstatscollector&list_id=243568
Analytics > Wikimetrics https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=wikimetrics
Analytics > Wikistats https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=wikistats
Analytics > Limn https://bugzilla.wikimedia.org/buglist.cgi?product=analytics&component=limn
Analytics > General/Unknown https://bugzilla.wikimedia.org/buglist.cgi?product=Analytics&component=General%2FUnknown
Commons App > iOS (iPhone or iPad) https://bugzilla.wikimedia.org/buglist.cgi?product=Commons%20App&component=iOS%20%28iPhone%20or%20iPad%29
Wikipedia App https://bugzilla.wikimedia.org/buglist.cgi?product=wikipedia%20app
Wiki Loves Monuments > Mobile https://bugzilla.wikimedia.org/buglist.cgi?product=Wiki%20Loves%20Monuments&component=Mobile
Wikimedia > Continuous integration https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Continuous%20integration
Wikimedia > DNS https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=dns
Wikimedia > OTRS https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=otrs
Wikimedia > Bugzilla https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=bugzilla
Wikimedia > wikibugs IRC bot https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=wikibugs%20IRC%20bot
Wikimedia > Blog https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=blog
Wikimedia > Fundraising: Misc. https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Fundraising%3A%20Misc.
Wikimedia > Fundraising: Requirements https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=Fundraising%3A%20Requirements
Tools > code-utils https://bugzilla.wikimedia.org/buglist.cgi?product=tools&component=code-utils
Tools > mw-dumper https://bugzilla.wikimedia.org/buglist.cgi?product=tools&component=mwdumper
Pywikibot > * https://bugzilla.wikimedia.org/buglist.cgi?product=Pywikibot
MediaWiki-Vagrant > * https://bugzilla.wikimedia.org/buglist.cgi?product=MediaWiki-Vagrant
Wikimedia Labs > tools https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia%20labs&component=tools
openZIM > * https://bugzilla.wikimedia.org/buglist.cgi?product=openZIM
Wikimedia > Quality Assurance https://bugzilla.wikimedia.org/buglist.cgi?product=wikimedia&component=quality%20assurance

I have checked all of them and works. So tomorrow you should have the new info.

(In reply to comment #6)

Core Extensions

Don't want to spend too much time going through the list and syncing with
https://bugzilla.wikimedia.org/editcomponents.
cgi?product=MediaWiki%20extensions
however noteworthy naming differences from the top of my head:

Currently korma lists all the extensions in a single project. This is good enough for now, but for the Bugzilla Response Time KPI [1] we will need to be more precise:

  • Including only the key projects.
  • Treating each component separately, just like we do with code repos.

[1] https://www.mediawiki.org/wiki/Community_metrics#Bugzilla_response_time