CVE-2026-72818: NLTK TweetTokenizer vulnerable to denial of service through catastrophic regex backtracking
(updated )
The URLS regular expression in nltk/tokenize/casual.py, compiled into TweetTokenizer.WORD_RE and applied by TweetTokenizer.tokenize, contains a naked-domain branch whose domain-label prefix [a-z0-9]+(?:[.-][a-z0-9]+)* is unbounded. Input consisting of many alternating label separators can be partitioned in exponentially many ways, and because the branch also requires a trailing top-level domain that such input never supplies, the engine explores those partitions before failing at each offset. A few kilobytes of input therefore consumes seconds to minutes of single-threaded CPU, and the HANG_RE substitution performed before matching does not collapse the pattern. TweetTokenizer is intended for tokenizing untrusted social-media text, so any service that applies it, or the module-level casual_tokenize, to submitted text can be stalled per request without authentication. Version 3.10.1 bounds the label repetition.
References
- github.com/advisories/GHSA-qx2g-xrx7-vfh8
- github.com/nltk/nltk/blob/3.9.4/nltk/tokenize/casual.py
- github.com/nltk/nltk/commit/e092ed52eccae642304448bffc8d23cb301f85c1
- github.com/nltk/nltk/issues/3704
- github.com/nltk/nltk/pull/3701
- github.com/nltk/nltk/releases/tag/v3.10.1
- nvd.nist.gov/vuln/detail/CVE-2026-72818
- www.vulncheck.com/advisories/nltk-tweettokenizer-url-pattern-backtracks-catastrophically-on-naked-domain-like-input
Code Behaviors & Features
Detect and mitigate CVE-2026-72818 with GitLab Dependency Scanning
Secure your software supply chain by verifying that all open source dependencies used in your projects contain no disclosed vulnerabilities. Dependency Scanning using SBOM also detects vulnerabilities from proprietary advisories that this site does not include. Learn more about Dependency Scanning using SBOM →