Spiral: splitters for identifiers in source code files

Spiral is a Python module that provides several different functions for splitting identifiers found in source code files. Identifier splitting (also known as identifier name tokenization) is the task of breaking apart program identifier strings such as getInt or readUTF8stream into component tokens: [get, int] and [read, utf8, stream]. The need for splitting identifiers arises in a variety of contexts, including natural language processing (NLP) methods applied to source code analysis and program comprehension. Spiral provides some basic naive splitting algorithms, such as a straightforward camel-case splitter, as well as more elaborate heuristic splitters, such as an algorithm we call Ronin.

The name Spiral is a loose acronym based on "SPlitters for IdentifieRs: A Library".