MSIX at Scale: An Automated Packaging Study of 3,261 Windows Application Cases
Description
Abstract
Background: MSIX is Microsoft’s package format for installing and managing Windows applications. This study evaluated whether an automated workflow could construct MSIX packages and perform initial validation across a large and heterogeneous set of existing Windows applications.
Methods: We analysed records from June 2026 for 3,261 application cases in which MSIX packaging was attempted using EtherApps Forge. Applications were identified through searches of the public Windows Package Manager catalogue. Each case was counted once, irrespective of outcome. Recorded smoke-test passes were verified against their associated saved test reports. Smoke testing assessed installation, start-up and cleanup, but did not evaluate application functionality comprehensively.
Results: Of 3,261 cases, 2,957 (90.68%) produced an MSIX package build, 2,919 (89.51%) completed installation and registration, 2,638 (80.90%) launched a selected program within the package, and 2,610 (80.04%) completed the defined smoke test successfully. Successful cases spanned eight installer and distribution types. All 2,610 reports associated with recorded smoke-test passes were consistent with the test fields examined during verification. Six pairs of cases shared identical reports, and two cases classified as passing launched a deactivation utility rather than a verified main application.
Conclusions: In this dataset, automated MSIX packaging and initial validation were completed successfully for a substantial proportion of attempted application cases. The findings demonstrate the feasibility of using EtherApps Forge to construct and perform initial checks on MSIX packages at scale and support further application-specific evaluation of MSIX as a packaging option. These results should not be interpreted as a general MSIX compatibility rate or evidence of production readiness. Further work should include application-function testing, more complete environment records and validation in representative deployment environments.
Research status: This company-authored preprint (Version 1) has not been peer reviewed. An accompanying analytical supplement provides sanitised case-level data, methodological notes and scripts for reproducing the reported calculations, but does not contain all materials required to repeat the original application tests.
Files
105281zenodo21985871.pdf
Files
(861.1 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:9280c59a08c403ae9762b9e47229f2a2
|
682.5 kB | Preview Download |
|
md5:2dddeb8f5bc319843ae79a8b5e07ec2d
|
178.5 kB | Preview Download |
Additional details
References
- [1] Microsoft. What is MSIX? Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/overview [2] Microsoft. Sign an MSIX package. Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/package/signing-package-overview [3] Microsoft. Create an MSIX package from any desktop installer (MSI, EXE, ClickOnce or App-V). Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/packaging-tool/create-app-package [4] Microsoft. Prepare your environment for conversion. Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/packaging-tool/prepare-your-environment [5] Microsoft. MSIX containerization overview. Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/msix-containerization-overview [6] ACM SIGSOFT. Empirical Standards for Software Engineering Research: General Standard. Accessed 21 September 2026. https://www2.sigsoft.org/EmpiricalStandards/docs/standards [7] Runeson P, Höst M. Guidelines for conducting and reporting case study research in software engineering. Empirical Software Engineering. 2009;14(2):131-164. https://doi.org/10.1007/s10664-008-9102-8 [8] EfficientEther Research. MSIX application-case analytical dataset and reproducibility supplement. Version 1, 21 September 2026. Accompanying dataset: MSIX_3261_Analytical_Supplement.zip. Source SHA-256 and release checksums included. [9] Guo PJ, Engler D. CDE: Using System Call Interposition to Automatically Create Portable Software Packages. USENIX Annual Technical Conference. 2011. https://www.usenix.org/conference/usenixatc11/cde-using-system-call-interposition-automatically-create-portable-software [10] Porter DE, Boyd-Wickizer S, Howell J, Olinsky R, Hunt GC. Rethinking the Library OS from the Top Down. ASPLOS. 2011. https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/asplos2011-drawbridge.pdf [11] Baltes S, Ralph P. Sampling in software engineering research: a critical review and guidelines. Empirical Software Engineering. 2022;27:94. https://doi.org/10.1007/s10664-021-10072-8 [12] Barr ET, Harman M, McMinn P, Shahbaz M, Yoo S. The Oracle Problem in Software Testing: A Survey. IEEE Transactions on Software Engineering. 2015;41(5):507-525. https://doi.org/10.1109/TSE.2014.2372785 [13] Microsoft. Run, debug, and test an MSIX package. Microsoft Learn. Accessed 21 September 2026. https://learn.microsoft.com/windows/msix/desktop/desktop-to-uwp-debug