[wp-trac] [WordPress Trac] #51670: Multisite test failures on GitHub Actions

[WordPress Trac]

#51670: Multisite test failures on GitHub Actions
------------------------------+--------------------
 Reporter:  SergeyBiryukov    |      Owner:  (none)
     Type:  defect (bug)      |     Status:  new
 Priority:  normal            |  Milestone:  5.6
Component:  Build/Test Tools  |    Version:
 Severity:  normal            |   Keywords:
  Focuses:                    |
------------------------------+--------------------
 Background: #50401, #49594.

 Starting with [49369], there are now some failures in Multisite tests on
 GitHub Actions, as seen in [https://github.com/WordPress/wordpress-
 develop/runs/1324145981 this build] for example:
 {{{
 1) Tests_L10n::test_wp_get_installed_translations_for_core
 Failed asserting that two strings are identical.
 --- Expected
 +++ Actual
 @@ @@
 -'2016-10-26 00:01+0200'
 +'2020-08-28 07:36:49+0000'

 /var/www/tests/phpunit/tests/l10n.php:79

 2) Tests_Locale_Switcher::test_switch_to_site_locale_if_user_locale_is_set
 Failed asserting that two strings are identical.
 --- Expected
 +++ Actual
 @@ @@
 -'de_DE'
 +'de'

 /var/www/tests/phpunit/tests/l10n/localeSwitcher.php:298

 3)
 Tests_Locale_Switcher::test_switch_to_different_site_locale_if_user_locale_is_set
 Failed asserting that two strings are identical.
 --- Expected
 +++ Actual
 @@ @@
 -'de_DE'
 +'de'

 /var/www/tests/phpunit/tests/l10n/localeSwitcher.php:351

 4)
 Tests_Privacy_WpPrivacySendPersonalDataExportEmail::test_should_send_personal_data_export_email_in_user_locale
 Failed asserting that '[Test Blog] Personal Data Export' contains
 "Exportación de datos personales".

 /var/www/tests/phpunit/tests/privacy/wpPrivacySendPersonalDataExportEmail.php:344

 5)
 Tests_Privacy_WpPrivacySendPersonalDataExportEmail::test_should_send_personal_data_export_email_in_user_locale_when_site_is_not_en_us
 Failed asserting that '[Test Blog] Personal Data Export' contains "Export
 personenbezogener Daten".

 /var/www/tests/phpunit/tests/privacy/wpPrivacySendPersonalDataExportEmail.php:366

 6)
 Tests_Privacy_WpPrivacySendPersonalDataExportEmail::test_should_send_personal_data_export_email_in_user_locale_when_admin_and_site_have_different_locales
 Failed asserting that '[Test Blog] Personal Data Export' contains
 "Exportación de datos personales".

 /var/www/tests/phpunit/tests/privacy/wpPrivacySendPersonalDataExportEmail.php:388

 7)
 Tests_Privacy_WpPrivacySendPersonalDataExportEmail::test_should_send_personal_data_export_email_in_user_locale_when_both_have_different_locales_than_site
 Failed asserting that '[Test Blog] Personal Data Export' contains "Export
 personenbezogener Daten".

 /var/www/tests/phpunit/tests/privacy/wpPrivacySendPersonalDataExportEmail.php:412

 8)
 Tests_Privacy_WpPrivacySendPersonalDataExportEmail::test_should_send_personal_data_export_email_in_site_locale_when_not_en_us_and_admin_has_different_locale
 Failed asserting that '[Test Blog] Personal Data Export' contains
 "Exportación de datos personales".

 /var/www/tests/phpunit/tests/privacy/wpPrivacySendPersonalDataExportEmail.php:459
 }}}

 These tests seem to pass as expected on Travis, so this might be something
 specific to GitHub Actions.

 After some initial debugging, it looks like for some reason these tests
 end up using the latest translation files from GlotPress, instead of the
 ones from the `tests/phpunit/data/languages` directory, even though the
 tests bootstap file specifically sets `WP_LANG_DIR` to `DIR_TESTDATA .
 '/languages'`. This will need more investigation.

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/51670>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform