Handling UTF-8 in header bodies

[Julien-Elie]

In errlog:

Traceback (most recent call last):
 File "/usr/lib/python3.11/logging/__init__.py", line 1113, in emit
 stream.write(msg + self.terminator)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 139-141: ordinal not in range(128)
Call stack:
 File "/home/news/bin/filter/filter_innd.py", line 349, in filter_art
 return self.pyfilter.filter(art)
 File "/home/news/bin/filter/filter_innd.py", line 1042, in filter
 logging.info("post: mid=%s, from=%s, groups=%s",
Message: 'post: mid=%s, from=%s, groups=%s'
Arguments: ('<0Tl24at1I10l0Nfm%dennis@coredump.d--p.de>', 'Dennis Preiser <d__p@d--p.de>', 'trigofacile.test.\u03c5\u03c4\u03c68')

Seen when posting to a newsgroup named trigofacile.test.υτφ8 (using an internationalized name in UTF-8).

The error is triggered by:

 # All tests passed. Log the locally posted message.
 logging.info("post: mid=%s, from=%s, groups=%s",
 mem2str(art[Message_ID]), mem2str(art[From]),
 mem2str(art[Newsgroups]))

[crooks]

Hi Julien,

Thanks for reporting this. I wonder if the solution is simply to use utf8 encoding in the logging handler. I've checked the documentation and this appears to also be compatible with python 2.7. I've created a new branch called log_handler_unicode with the encoding specified. Would you mind giving it a try?

Best regards,
Steve

[Julien-Elie]

Sure, I'll give it a try and tell you in two weeks, when I come back home after holidays. I'll disconnect a bit :)

[Julien-Elie]

Just tested, and I confirm the patch works fine.
There's no longer a UnicodeEncodeError error. Thanks for the fix!