[wp-trac] [WordPress Trac] #63863: Standardize UTF-8 handling and fallbacks in 6.9

[WordPress Trac]

#63863: Standardize UTF-8 handling and fallbacks in 6.9
--------------------------------------+---------------------
 Reporter:  dmsnell                   |       Owner:  (none)
     Type:  enhancement               |      Status:  new
 Priority:  normal                    |   Milestone:  6.9
Component:  Charset                   |     Version:  trunk
 Severity:  normal                    |  Resolution:
 Keywords:  has-patch has-unit-tests  |     Focuses:
--------------------------------------+---------------------

Comment (by dmsnell):

 In [changeset:"60768" 60768]:
 {{{
 #!CommitTicketReference repository="" revision="60768"
 Charset: Introduce UTF-8 scanning pipeline.

 This is the third in a series of patches to modernize and standardize
 UTF-8 handling.

 When the fallback UTF-8 validation code was added it was placed inside
 formatting.php; however, that validation logic can be reused for a number
 of related UTF-8 functions. To faciliate this it was moved into a new
 location and loaded early. This patch is follow-up to that first half,
 whereby the UTF-8 scanning logic forms its own new `_wp_scan_utf8()`
 function. This new UTF-8 scanner is a low-level function which forms a
 shared spec-compliant processing core to power multiple fallback functions
 and some new functionality as well.

 Developed in https://github.com/WordPress/wordpress-develop/pull/9830
 Discussed in https://core.trac.wordpress.org/ticket/63863

 Follow-up to: [60743].

 See #63863.
 }}}

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/63863#comment:26>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform