Now that we're nearly done with the first phase of metrics study 6 (tracking edit conversions from CTA 1), we would like to start the second phase, to track how many users create an account from CTA 4, which invites them to sign up after posting feedback.
For this new phase of study 6, we have created a task card and checklist on Trello to
track our progress:
https://trello.com/card/aft5-edit-cta-conversions-using-current-data/5069e3859c41bc8f712411a3/6
See also this related Bugzilla ticket:
https://bugzilla.wikimedia.org/show_bug.cgi?id=40775
From a development standpoint, here are some of the main action items that are needed for this test:
a) change the bucketing parameters to show the CTA4 at 100% for all readers who are not logged in.
b) add a special tag that identifies this campaign as being from AFT5 and from CTA4 (e.g.: 'aft5-cta4') and pass it as a URL parameter, so that the new account is correctly associated with AFT by the new ACUX module. Exact link and parameter to be worked out with Dario and S. Page.
c) disable clicktracking of impressions of the CTA1, clicks on the CTA1, clicks on the Edit Save button, and any clicks for the Page Edit (and Section Edit)buttons.
d) test thoroughly that we are collecting the proper data and tagging edits correctly on prototype, then on testing, before deployment.
Dario will provide more details in comments below on what exact codes and tags we want to use to track this properly.
In addition to measuring the percentage of feedback posters who create new accounts, Dario and Aaron plan to conduct a longitudinal study to find out how many of these new members go on to edit productively on Wikipedia.
See also section 1 of this Etherpad page for more details on our overall pre-rampup data collection plan for this study 6:
http://etherpad.wikimedia.org/AFT5PreRampUpData
For more info on our CTAs and how AFT5 works, check this feature requirements page:
http://www.mediawiki.org/wiki/Article_feedback/Version_5/Feature_Requirements#CTA_4:_Create_an_account_or_login
Version: unspecified
Severity: normal