aboutcode-org/scancode-toolkit: v32.5.0

This is a minor scancode release with:

• license, package detection performance improvements

• better copyright, license and package detection

• python3.14 support, and removed python3.9 wheels

• Improve package scan performance by:

  • Skipping binary package detection steps by default, and introducing a new CLI option --package-in-compiled to detect packages in compiled binaries like rust/go binaries Note: previously these were detected in --package CLI option directly but this is no longer the case, you've to use the new --package-in-compiled to detect packages from go/rust and other binaries

  • Creating cached regex patterns and multiregex pre-matchers, for a fast package path detection filtering step

  https://github.com/aboutcode-org/scancode-toolkit/pull/4606

• Add gibberish detection to copyright scanning. This is done using a 2-character Markov chain. A new CLI command, scancode-train-gibberish-model, has been added to regenerate the model used by the detector. https://github.com/aboutcode-org/scancode-toolkit/pull/4610 https://github.com/aboutcode-org/scancode-toolkit/issues/2402

• Use a cython implementation of sequence matcher to improve license detection performance https://github.com/aboutcode-org/scancode-toolkit/pull/4500

• Add python3.14 support in scancode https://github.com/aboutcode-org/scancode-toolkit/pull/4595 https://github.com/aboutcode-org/scancode-toolkit/issues/4541

• Always print license references table in html output https://github.com/aboutcode-org/scancode-toolkit/pull/4474

• Enable License References table for HTML Output without requiring --license-references by implementing a fallback license reference collection based on the behavior of v32.0.0. https://github.com/aboutcode-org/scancode-toolkit/pull/4474 https://github.com/aboutcode-org/scancode-toolkit/issues/4101

• Replace unmaintained toml library with tomllib / tomli. https://github.com/aboutcode-org/scancode-toolkit/issues/4532

• Pin fingerprints and normality to avoid pyicu https://github.com/aboutcode-org/scancode-toolkit/issues/4493

• Fix click compatibility issues and failures https://github.com/aboutcode-org/scancode-toolkit/issues/4572

• Remove deprecated ast module attributes https://github.com/aboutcode-org/scancode-toolkit/pull/4539

• Fix cargo scanning failures https://github.com/aboutcode-org/scancode-toolkit/issues/4581

• Reorg and improve docs user experience https://github.com/aboutcode-org/scancode-toolkit/pull/4629

• Handle is_private strings in npm properly https://github.com/aboutcode-org/scancode-toolkit/pull/4635

• Restructure README docs https://github.com/aboutcode-org/scancode-toolkit/pull/4667

• Add new licenses, license rules and misc license detection improvements https://github.com/aboutcode-org/scancode-toolkit/pull/4562 https://github.com/aboutcode-org/scancode-toolkit/pull/4674 https://github.com/aboutcode-org/scancode-toolkit/pull/4666 https://github.com/aboutcode-org/scancode-toolkit/pull/4622

What's Changed

• feat(OutputHTML): Always print license references table by @pepper-jk in https://github.com/aboutcode-org/scancode-toolkit/pull/4474
• Cython seq by @JonoYang in https://github.com/aboutcode-org/scancode-toolkit/pull/4500
• Update cyseq to v0.0.2 by @JonoYang in https://github.com/aboutcode-org/scancode-toolkit/pull/4512
• Add new licenses to LicenseDB by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4517
• Pin fingerprints and normality by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4531
• Fix click compatibility issues by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4591
• packagedcode: replace unmaintained toml with tomllib/tomli by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4594
• packagedcode: replace unmaintained toml with tomllib/tomli by @gotmax23 in https://github.com/aboutcode-org/scancode-toolkit/pull/4532
• packagedcode: don't use removed ast module attributes by @gotmax23 in https://github.com/aboutcode-org/scancode-toolkit/pull/4539
• Add new licenses from dejacode by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4562
• Fixes #4581: Failure to scan cargo by @omsuneri in https://github.com/aboutcode-org/scancode-toolkit/pull/4582
• Add tag to ruby license rule by @pombredanne in https://github.com/aboutcode-org/scancode-toolkit/pull/4622
• docs: Reorg and improve user experience by @tsteenbe in https://github.com/aboutcode-org/scancode-toolkit/pull/4629
• Handle string is private by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4635
• Restructure the README by @DennisClark in https://github.com/aboutcode-org/scancode-toolkit/pull/4667
• Detect plantuml license by @uttam282005 in https://github.com/aboutcode-org/scancode-toolkit/pull/4666
• Improve package scan performance by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4606
• Detect gibberish copyright #2402 by @JonoYang in https://github.com/aboutcode-org/scancode-toolkit/pull/4610
• Make CC-BY-NC-3 rule more specific by @alexzurbonsen in https://github.com/aboutcode-org/scancode-toolkit/pull/4674
• Add python3.14 to test support by @AyanSinhaMahapatra in https://github.com/aboutcode-org/scancode-toolkit/pull/4595

New Contributors

• @pepper-jk made their first contribution in https://github.com/aboutcode-org/scancode-toolkit/pull/4474
• @omsuneri made their first contribution in https://github.com/aboutcode-org/scancode-toolkit/pull/4582
• @uttam282005 made their first contribution in https://github.com/aboutcode-org/scancode-toolkit/pull/4666

Full Changelog: https://github.com/aboutcode-org/scancode-toolkit/compare/v32.4.1...v32.5.0