-
Notifications
You must be signed in to change notification settings - Fork 960
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Various tags such as q, br, ins, del are not fitered out #300
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Many elements/tags appear in wikiextractor's output, such as
poem
,q
,ins
,del
,br
,section
,onlyinclude
,includeonly
,math
or mathematical equations (with commands such as\mathbf
) not enclosed in any tags.https://dumps.wikimedia.org/enwiki/20221020/enwiki-20221020-pages-articles1.xml-p1p41242.bz2
wikiextractor --no-templates --html-safe '' -o - dumps.wikimedia.org/enwiki/20221020/enwiki-20221020-pages-articles1.xml-p1p41242.bz2 | grep '<\(poem\|q\|section\|ins\|del\|math\|onlyinclude\|br\|chem\)\b'
Examples from the output:
(Not all of the tags appear in this particular dump.)
The text was updated successfully, but these errors were encountered: