Codecs should raise precise UnicodeDecodeError or UnicodeEncodeError

[pitrou]

BPO	41115
Nosy	@malemburg, @doerwalter, @pitrou, @benjaminp, @ezio-melotti, @serhiy-storchaka, @srinivasreddy, @eamanu, @utkarsh261
PRs	gh-85287: Convert UnicodeError to UnicodeEncodeError| UnicodeDecodeError  #21165 bpo-41115: Modified src to raise rather Unicode{Encode, Decode}Error rather than plain UnicodeError #21170

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2020-06-25.12:49:30.420>
labels = ['easy', 'type-bug', '3.8', '3.9', '3.7', 'library']
title = 'Codecs should raise precise UnicodeDecodeError or UnicodeEncodeError'
updated_at = <Date 2020-06-26.16:59:17.544>
user = 'https://github.com/pitrou'

bugs.python.org fields:

activity = <Date 2020-06-26.16:59:17.544>
actor = 'utk'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2020-06-25.12:49:30.420>
creator = 'pitrou'
dependencies = []
files = []
hgrepos = []
issue_num = 41115
keywords = ['patch', 'easy']
message_count = 6.0
messages = ['372367', '372368', '372369', '372373', '372431', '372433']
nosy_count = 9.0
nosy_names = ['lemburg', 'doerwalter', 'pitrou', 'benjamin.peterson', 'ezio.melotti', 'serhiy.storchaka', 'thatiparthy', 'eamanu', 'utk']
pr_nums = ['21165', '21170']
priority = 'normal'
resolution = None
stage = 'patch review'
status = 'open'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue41115'
versions = ['Python 3.7', 'Python 3.8', 'Python 3.9']

Linked PRs

• gh-85287: Change codecs to raise precise UnicodeEncodeError and UnicodeDecodeError #113674

[pitrou]

A number of codecs raise bare UnicodeError, rather than Unicode{Decode,Encode}Error. Example:

File "/home/antoine/miniconda3/envs/pyarrow/lib/python3.7/encodings/utf_16.py", line 67, in _buffer_decode
raise UnicodeError("UTF-16 stream does not start with BOM")

A more complete list can be found here:
https://gist.github.com/pitrou/60594b28d8e47edcdb97d9b15d5f9866

[srinivasreddy]

This looks like an easy task. Shall I create a PR?

[eamanu]

Hi,

IMO this can be mark as an easy issue.

@thatiparthy please, go ahead