To cite the tokenizers package in publications, please cite the paper in the Journal of Open Source Software:

Mullen LA, Benoit K, Keyes O, Selivanov D, Arnold J (2018). “Fast, Consistent Tokenization of Natural Language Text.” Journal of Open Source Software, 3, 655. doi:10.21105/joss.00655, https://doi.org/10.21105/joss.00655.

Corresponding BibTeX entry:

  @Article{,
    title = {Fast, Consistent Tokenization of Natural Language Text},
    author = {Lincoln A. Mullen and Kenneth Benoit and Os Keyes and
      Dmitry Selivanov and Jeffrey Arnold},
    journal = {Journal of Open Source Software},
    year = {2018},
    volume = {3},
    issue = {23},
    pages = {655},
    url = {https://doi.org/10.21105/joss.00655},
    doi = {10.21105/joss.00655},
  }