Python wrapper for SentencePiece. This API supports the encoding, decoding, and training of SentencePiece models. For a detailed feature and API comparison with Hugging Face Tokenizers and OpenAI's ...
Wikipedia-API is easy to use Python wrapper for Wikipedias' API. It supports extracting texts, sections, links, categories, translations, etc from Wikipedia. Documentation provides code snippets for ...