[wp-trac] [WordPress Trac] #63863: Standardize UTF-8 handling and fallbacks in 6.9

[WordPress Trac]

#63863: Standardize UTF-8 handling and fallbacks in 6.9
--------------------------------------+---------------------
 Reporter:  dmsnell                   |       Owner:  (none)
     Type:  enhancement               |      Status:  new
 Priority:  normal                    |   Milestone:  6.9
Component:  Charset                   |     Version:  trunk
 Severity:  normal                    |  Resolution:
 Keywords:  has-patch has-unit-tests  |     Focuses:
--------------------------------------+---------------------

Comment (by dmsnell):

 @welcher this is a tracking ticket so I think by default it will “make it”
 into 6.9. Whatever associated work that isn’t merged will be punted to a
 new tracking ticket for 7.0.

 There are four things I would still like to try and get in for 6.9:

  - New fallback for `mb_substr()` in [https://github.com/WordPress
 /wordpress-develop/pull/9829 wordpress/wordpress-develop#9829]
  - Replace single use of PCRE in HTML API in [https://github.com/WordPress
 /wordpress-develop/pull/9798 wordpress/wordpress-develop#9798] and in
 [https://github.com/WordPress/wordpress-develop/pull/9827 wordpress
 /wordpress-develop#9827]
  - Deprecated polyfills for `utf8_encode()` and `utf8_decode()` in
 [https://github.com/WordPress/wordpress-develop/pull/10011 wordpress
 /wordpress-develop#10011]

 There is also a new utility I find useful that I would like to add, unless
 there’s opposition:

  - Operate on valid parts of UTF-8 string while preserving the invalid
 bytes in [https://github.com/WordPress/wordpress-develop/pull/9826
 wordpress/wordpress-develop#9826]

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/63863#comment:36>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform