udpipe: Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing with the 'UDPipe' 'NLP' Toolkit

This natural language processing toolkit provides language-agnostic 'tokenization', 'parts of speech tagging', 'lemmatization' and 'dependency parsing' of raw text. Next to text parsing, the package also allows you to train annotation models based on data of 'treebanks' in 'CoNLL-U' format as provided at <https://universaldependencies.org/format.html>. The techniques are explained in detail in the paper: 'Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0 with UDPipe', available at <doi:10.18653/v1/K17-3009>. The toolkit also contains functionalities for commonly used data manipulations on texts which are enriched with the output of the parser. Namely functionalities and algorithms for collocations, token co-occurrence, document term matrix handling, term frequency inverse document frequency calculations, information retrieval metrics (Okapi BM25), handling of multi-word expressions, keyword detection (Rapid Automatic Keyword Extraction, noun phrase extraction, syntactical patterns) sentiment scoring and semantic similarity analysis.

Version:	0.8.16
Depends:	R (≥ 2.10)
Imports:	Rcpp (≥ 0.11.5), data.table (≥ 1.9.6), Matrix, methods, stats
LinkingTo:	Rcpp
Suggests:	knitr, rmarkdown, topicmodels, lattice, parallel
Published:	2026-01-30
DOI:	10.32614/CRAN.package.udpipe
Author:	Jan Wijffels [aut, cre, cph] (R wrapper), BNOSAC [cph] (R wrapper), Institute of Formal and Applied Linguistics, Faculty of Mathematics and Physics, Charles University in Prague, Czech Republic [cph] (src/udpipe.cpp & src/udpipe.h), Milan Straka [aut, cph] (src/udpipe.cpp & src/udpipe.h), Jana Straková [ctb, cph] (src/udpipe.cpp & src/udpipe.h)
Maintainer:	Jan Wijffels <jwijffels at bnosac.be>
License:	MPL-2.0
URL:	https://bnosac.github.io/udpipe/en/index.html, https://github.com/bnosac/udpipe
NeedsCompilation:	yes
Materials:	README, NEWS
In views:	NaturalLanguageProcessing
CRAN checks:	udpipe results

Documentation:

Reference manual:

udpipe.html , udpipe.pdf

Vignettes:

UDPipe Natural Language Processing - Text Annotation (source, R code) UDPipe Natural Language Processing - Parallel (source, R code) UDPipe Natural Language Processing - Model Building (source, R code) UDPipe Natural Language Processing - Try it out (source, R code) UDPipe Natural Language Processing - Universe (source, R code) UDPipe Natural Language Processing - Basic Analytical Use Cases (source, R code) UDPipe Natural Language Processing - Topic Modelling Use Cases (source, R code)

Downloads:

Package source:	udpipe_0.8.16.tar.gz
Windows binaries:	r-devel: udpipe_0.8.16.zip, r-release: udpipe_0.8.16.zip, r-oldrel: udpipe_0.8.16.zip
macOS binaries:	r-release (arm64): udpipe_0.8.16.tgz, r-oldrel (arm64): udpipe_0.8.16.tgz, r-release (x86_64): udpipe_0.8.16.tgz, r-oldrel (x86_64): udpipe_0.8.16.tgz
Old sources:	udpipe archive

Reverse dependencies:

Reverse imports:	cleanNLP, corpustools, finnsurveytext, MadanText, MadanTextNetwork, sumup, tall, TextForecast
Reverse suggests:	birddog, BTM, doc2vec, nametagger, pseudobibeR, text2vec, textplot, textrank, textrecipes, topicmodels.etm, word2vec
Reverse enhances:	NLP

Linking:

Please use the canonical form https://CRAN.R-project.org/package=udpipe to link to this page.