Involves building a search engine on the Wikipedia Data Dump using the data dump of 2013 of size 43 GB. The search results returns in real time.
-
Updated
May 23, 2014 - Python
Involves building a search engine on the Wikipedia Data Dump using the data dump of 2013 of size 43 GB. The search results returns in real time.
Clustering of Spanish Wikipedia articles.
Python script to split the text generated by 'wikipedia parallel title extractor' into separate text files (separate file for each language)
A Search Engine built based on Wikipedia dump of 75GB. Involves creation of Index file and returns search results in real time
Convert WIKI dumped XML (Chinese) to human readable documents in markdown and txt.
Command line tool to extract plain text from Wikipedia database dumps
Corpus creator for Chinese Wikipedia
A search engine trained from a corpus of wikipedia articles to provide efficient query results.
Wikipedia text corpus for self-supervised NLP model training
Some Faroese language statistics taken from fo.wikipedia.org content dump
A complete Python text analytics package that allows users to search for a Wikipedia article, scrape it, conduct basic text analytics and integrate it to a data pipeline without writing excessive code.
(Ongoing module in development) Getting Wikipedia articles parsed content. Created for getting text corpuses data fast and easy. But can be freely used for other purpuses too
Create a wiki corpus using a wiki dump file for Natural Language Processing
Collects a multimodal dataset of Wikipedia articles and their images
Python package for working with MediaWiki XML content dumps
Add a description, image, and links to the wikipedia-corpus topic page so that developers can more easily learn about it.
To associate your repository with the wikipedia-corpus topic, visit your repo's landing page and select "manage topics."