Page MenuHomePhabricator

Investigate how often browser tests fail because of Jenkins performance problems (tracking)
Closed, InvalidPublic

Description

Strange failures:

#1
Jenkins: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/202/testReport/(root)/Menus%20open%20correct%20page/Home_URL_is_set_correctly/

Error: expected "data:text/html,chromewebdata" to match "Main_Page" (RSpec::Expectations::ExpectationNotMetError)

Sauce Labs: https://saucelabs.com/jobs/a7de9ca45e664a53ba14a2e8f05ef80a
Error: no data received

#2
Jenkins: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/203/testReport/(root)/Header%20Validation%20-%20Logged%20In/Watchlist_icon_from_article_page/

Error: timed out after 5 seconds, waiting for {:id=>"wpName1", :tag_name=>"input or textarea", :type=>"(any text type)"} to become present (Watir::Wait::TimeoutError)

Sauce Labs: http://saucelabs.com/jobs/b61b0d8c421a4dc18366c41f4ef625c5

Error: no data received

#3
Jenkins: https://wmf.ci.cloudbees.com/job/MobileFrontend-en.m.wikipedia.beta.wmflabs.org-linux-chrome/204/testReport/junit/(root)/Menus%20open%20correct%20page/Home_URL_is_set_correctly/

Error: Unable to pick a platform for the provided browser (RuntimeError)

Sauce Labs: https://saucelabs.com/jobs/f04d4a7230f64b93b6e7cc5e971ed8e9
Error: everything looks fine


Version: unspecified
Severity: normal
Whiteboard: zfilipin

Details

Reference
bz60338

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 2:55 AM
bzimport set Reference to bz60338.
bzimport added a subscriber: Unknown Object (MLST).

#4
permanent link to above failure is:
https://wmf.ci.cloudbees.com/job/browsertests-en.wikipedia.beta.wmflabs.org-linux-firefox/593/

Chris, when pasting Jenkins links make sure you do not paste the link with "lastCompletedBuild" because that always points to the last build. Replace "lastCompletedBuild" with job number, like "593".

In addition to contacting Sauce Labs support, it would be good to post the problem at Open Sauce Support forum too:

http://support.saucelabs.com/forums/21034924-Open-Sauce-Support

Changed this to tracking bug. Please report individual problems as separate bugs.

zeljkofilipin set Security to None.

Please report problems separately.