Skip to content

Varying script(s) to pull links/attachments from kemono.party

Notifications You must be signed in to change notification settings

6fe9d454/party-scripts

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

party-scripts

Scripts for pulling from kemono.party and coomer.party. Fortunately these do have an API, so these script(s) are a bit of shorthand for pulling contents.

notes

Requires Python 3.10.x+, be sure to install the contents in requirements.txt.

  • Be aware, there's nothing for tackling the DDoS protection.
  • There's some naive assumptions made for accounting for Imgur links which have ?fb or ?fbplay parameter to build links.
  • Just like bdsmlr-scripts, this dumps aria2 compatible contents (optionally with filenames specified with the --aria2-format arg).
  • The expectation is to just provide a list of links to varying kemono.party users/services (beta not accounted for, but it'd be trivial to account for it if you want).
  • It is heavily advisable that you run something like fdupes/jdupes to remove duplicates after downloading the attachments. There's a ton of them unfortunately.
  • The links collected will require some post processing on your part because of the weird formatting differences between all of the services encountered. It should be fairly simple to edit out the weirdness, then run it through a quick cat links.txt | sort | uniq > new_links.txt type of deal to remedy that.
  • The doubling of lxml xpath and bs4 with regex is to find links that may be properly setup as an HTML a tag, but sometimes posts are plain text, and these are not found. Therefore the link regex should pick it up (it might also pick up undesirable text too FYI).

About

Varying script(s) to pull links/attachments from kemono.party

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Languages