The primary focus of this release is from Pull Request #98, which adds a new Postgres DOMAIN called
fulltext_with_shingles. The tokenization scheme for this data type is such that right-trucated wildcard queries, especially when used within a "quoted phrase" are significantly faster. In some test cases, it's roughly 7500 times faster! The trade-off, of course, is slower indexing times and larger indexes. This is why the functionality has been added to a new datatype (rather than re-defining the existing
zdb_terms()) are no longer forced to upper-case – they're returned exactly as they're stored in the index
_allfield is used. The QueryParser wasn't properly noting that the
_allfield was used, which lead the highlighter to not expand it.