Page MenuHomePhabricator

unicode encoding grid engine
Closed, ResolvedPublic

Description

Author: dr.trigon

Description:
Pywikibot script sum_disc.py - usually working (e.g. on toolserver) - fails with following exception when executed through the grid engine jsub command:

Traceback (most recent call last):

File "/data/project/drtrigonbot/pywikibot-compat/pwb.py", line 163, in <module>
  execfile(sys.argv[0])
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 1730, in <module>
  main()
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 1721, in main
  bot.run()
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 385, in run
  self.postDiscSum()
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 1179, in postDiscSum
  self.putHistory(self.pages.hist)
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 685, in putHistory
  self._appendFile(str(buf))
File "/data/project/drtrigonbot/pywikibot-compat/sum_disc.py", line 720, in _appendFile
  encoding=config.textfile_encoding, mode='a+')
File "/usr/lib/python2.7/codecs.py", line 881, in open
  file = __builtin__.open(filename, mode, buffering)

UnicodeEncodeError: 'ascii' codec can't encode character u'\xba' in position 62: ordinal not in range(128)

The issue is caused by a unconventional username "º the Bench º", that is used within the filename string.

The intressting thing is; when the script gets runned through tools-labs console directly, it works properly - so it is somehow related to the grid engine runtime enivronment...?!

Thanks and Greetings


Version: unspecified
Severity: major

Details

Reference
bz58181

Related Objects

StatusSubtypeAssignedTask
Resolvedcoren
InvalidNone

Event Timeline

bzimport raised the priority of this task from to Needs Triage.Nov 22 2014, 2:31 AM
bzimport added a project: Toolforge.
bzimport set Reference to bz58181.

dr.trigon wrote:

MEMO for myself:

Snipplets from Cloud-Services:

(17:54:24) Coren: DrTrigon: It's almost certainly a local issue; make certain that $LANG is explicitly set to a suitable value.

(17:57:35) valhallasw: http://www.joelonsoftware.com/articles/Unicode.html < read this.

What about bug #58872, comment #1?

dr.trigon wrote:

bugfix; UnicodeEncodeError: 'ascii' codec can't encode character u'\xba' in position 62: ordinal not in range(128)

Change-Id: I9480323afdd482e6388520354af8a8784253c2cb

https://gerrit.wikimedia.org/r/#/c/103348/