Recursion bug found in EnglishTokenizer

[hankcs]

Some text in Wikipedia might trap the EnglishTokenizer into infinite recursion. E.g.,

from elit_tokenizer import EnglishTokenizer

tokenizer = EnglishTokenizer()
sentences = tokenizer.decode(
    '<graph>{"version":2,"width":440,"height":258,"data":[{"name":"table","values":[{"x":1801,"y":5},{"x":1881,"y":5},{"x":1901,"y":5},{"x":1911,"y":5},{"x":1921,"y":4},{"x":1951,"y":4},{"x":1961,"y":5},{"x":1971,"y":6},{"x":1981,"y":9},{"x":1991,"y":16},{"x":2001,"y":22},{"x":2011,"y":29}]}],"scales":[{"name":"x","type":"ordinal","range":"width","zero":false,"domain":{"data":"table","field":"x"}},{"name":"y","type":"linear","range":"height","nice":true,"domain":{"data":"table","field":"y"}}],"axes":[{"type":"x","scale":"x"},{"type":"y","scale":"y"}],"marks":[{"type":"rect","from":{"data":"table"},"properties":{"enter":{"x":{"scale":"x","field":"x"},"y":{"scale":"y","field":"y"},"y2":{"scale":"y","value":0},"fill":{"value":"steelblue"},"width":{"scale":"x","band":"true","offset":-1}}}}]}</graph>',
    segment=2)

Error log:
err.log