­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ ­ U =_0@s<dZddlZddlZddlZddlZddlmZddlmZddlm Z ddlm Z ddlm Z ddl m Z dd l mZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm!Z!ddlm"Z"ddlm#Z#ddlm$Z$ddlm%Z%dd lm&Z&ddlZerd!d"Zd#d$Z'Gd%d&d&eZ(e e&)ed'e&)eoe d(Gd)d*d*e(Z*e&)ed+Gd,d-d-e*Z+Gd.d/d/e(Z,e-d0kr8dd1l.m/Z/e/e0dS)2a: Notes about unicode handling in psutil ====================================== Starting from version 5.3.0 psutil adds unicode support, see: https://github.com/giampaolo/psutil/issues/1040 The notes below apply to *any* API returning a string such as process exe(), cwd() or username(): * all strings are encoded by using the OS filesystem encoding (sys.getfilesystemencoding()) which varies depending on the platform (e.g. "UTF-8" on macOS, "mbcs" on Win) * no API call is supposed to crash with UnicodeDecodeError * instead, in case of badly encoded data returned by the OS, the following error handlers are used to replace the corrupted characters in the string: * Python 3: sys.getfilesystemencodeerrors() (PY 3.6+) or "surrogatescape" on POSIX and "replace" on Windows * Python 2: "replace" * on Python 2 all APIs return bytes (str type), never unicode * on Python 2, you can go back to unicode by doing: >>> unicode(p.exe(), sys.getdefaultencoding(), errors="replace") For a detailed explanation of how psutil handles unicode see #1040. Tests ===== List of APIs returning or dealing with a string: ('not tested' means they are not tested to deal with non-ASCII strings): * Process.cmdline() * Process.connections('unix') * Process.cwd() * Process.environ() * Process.exe() * Process.memory_maps() * Process.name() * Process.open_files() * Process.username() (not tested) * disk_io_counters() (not tested) * disk_partitions() (not tested) * disk_usage(str) * net_connections('unix') * net_if_addrs() (not tested) * net_if_stats() (not tested) * net_io_counters() (not tested) * sensors_fans() (not tested) * sensors_temperatures() (not tested) * users() (not tested) * WindowsService.binpath() (not tested) * WindowsService.description() (not tested) * WindowsService.display_name() (not tested) * WindowsService.name() (not tested) * WindowsService.status() (not tested) * WindowsService.username() (not tested) In here we create a unicode path with a funky non-ASCII name and (where possible) make psutil return it back (e.g. on name(), exe(), open_files(), etc.) and make sure that: * psutil never crashes with UnicodeDecodeError * the returned path matches N)closing)BSD)OPENBSD)POSIX)WINDOWS)PY3)u)APPVEYOR)ASCII_FS)bind_unix_socket)chdir) CI_TESTING)copyload_shared_lib) create_exe) get_testfn)HAS_CONNECTIONS_UNIX) HAS_ENVIRON)HAS_MEMORY_MAPS)INVALID_UNICODE_SUFFIX)PsutilTestCase)PYPY) safe_mkdir safe_rmpath) serialrun)skip_on_access_denied)spawn_testproc) terminate TESTFN_PREFIX)UNICODE_SUFFIX)unittestcCs8ddlm}z ||WStk r2tYnXdS)Nrr) psutil.testsrZ WindowsError traceback print_exc)pathZrmr&L/opt/alt/python38/lib64/python3.8/site-packages/psutil/tests/test_unicode.pyrss  rc Csd}t|d}zhz.find_sockr(rjrk)kind)rr3r r.rr!rlrrMZnet_connectionsrrQrmrDrR)r5rtrWrnrsror&r&r'test_net_connectionss   zTestFSAPIs.test_net_connectionscCs,|jd}|t|t|t|dSr])r;r_rrrM disk_usage)r5rar&r&r'test_disk_usage"s  zTestFSAPIs.test_disk_usagerjz&ctypes does not support unicode on PY2zunstable on PYPYc srt|jd\}ddfddtD}dd|D}||||D]}||tqRW5QRXdS)Nr(cSstjtj|Sr?)rHr%realpathrS)rUr&r&r'normpath/sz-TestFSAPIs.test_memory_maps..normpathcsg|]}|jqSr&)r%.0xrzr&r' 1sz/TestFSAPIs.test_memory_maps..cSsg|]}t|kr|qSr&rr{r&r&r'r4s)rr3rMrNZ memory_mapsZassertInrQrD)r5Z funky_pathZlibpathsr%r&r~r'test_memory_maps(s  zTestFSAPIs.test_memory_mapsN)r7r8r9__doc__r r3 classmethodr>r@rKrVrYr\rbr!skipIfrrrirrprrrvrxrrrr&r&r&r'r:s0              r:zunreliable on CIc@s eZdZdZeZeddZdS)TestFSAPIsWithInvalidPathz-Test FS APIs with a funky, invalid path name.cCsdS)NTr&r<r&r&r'rK?sz1TestFSAPIsWithInvalidPath.expect_exact_path_matchN)r7r8r9rrr3rrKr&r&r&r'r:src@sBeZdZdZerendZee dee o.e dddZ dS) TestNonFSAPISz&Unicode tests for non fs-related APIs.èrjzsegfaults on PYPY + WINDOWScCsttj}|j|d<|j|d}t|j}|}|D] \}}| |t | |t q<| |d|jdS)NZ FUNNY_ARG)env) rHenvironcopyr3rrMrNrOitemsrQrDrR)r5rr0rUkvr&r&r'test_proc_environNs     zTestNonFSAPIS.test_proc_environN) r7r8r9rrr r3r!rrrrrr&r&r&r'rJs   r__main__) run_from_name)1rrHr,r#rE contextlibrrMrrrrZpsutil._compatrrr"r r r r r rrrrrrrrrrrrrrrrr r!r1r2rr:rrr7Zpsutil.tests.runnerr__file__r&r&r&r'sdD