Page MenuHomePhabricator

Compare screen shots from current and previous test run
Closed, DeclinedPublic

Description

Steps to do:

  • open a page (using selenium)
  • take a screen shot (built-in into selenium)
  • compare (pixel by pixel) with the previous screen shot (using something like chunky_png)
  • report if the more than x percent of the pixels are not the same

Repeat for interesting pages and browser+version/OS+version combinations.


Version: wmf-deployment
Severity: normal

Details

Reference
bz63107

Event Timeline

bzimport raised the priority of this task from to Low.Nov 22 2014, 3:03 AM
bzimport set Reference to bz63107.
bzimport added a subscriber: Unknown Object (MLST).

It would also be interesting to compare screenshots taken in different browsers in the same test run.

zeljkofilipin set Security to None.
zeljkofilipin subscribed.

We will investigate an existing solution soon: T90884.