Pageviews dumps stalled
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• bzimport
	May 31 2014, 5:23 PM

Description

Author: metatron

Description:
Pageviews dumps dried out. Last dump provided: pagecounts-20140530-150000

Version: unspecified
Severity: major
Whiteboard: u=caistleitner@wikimedia.org c=General/Unknown p=0 s=2014-05-29

• bzimport raised the priority of this task from to High.Nov 22 2014, 3:20 AM

• bzimport set Reference to bz65978.

metatron: Please provide a URL to reproduce / see the problem.
I assume this is some page somewhere on http://dumps.wikimedia.org/

metatron wrote:

The files are still there on gadolinium, so it looks like we're not loosing data,
but "only" copying the data files around is failing.

Change 136735 had a related patch set uploaded by QChris:
Provide default shell to datasets user

Change 136735 abandoned by QChris:
Provide default shell to datasets user

Reason:
Beaten by Change 136734

It seems Ops' cleanup around accounts reset the datasets user's shell,
so rsync failed. Apergos set rsync's shell again in

https://gerrit.wikimedia.org/r/#/c/136734

. That should fix the issue upon the next cron run and bring the missing
files over.
I'll report back when that happened.

The fix worked.
Files are back.
No missing data.

otto wrote:

Thanks Christian and Ariel (and all)!