Script for Curating an RSS Feed
See this blog post for more information.
Right now the script is kind of stupid and assumes you want to use S3 for persisting your feed. This could change later to allow some other options, but for now expect an error if you do not have your S3 credentials configured, as specified here: BotoConfig
$ ./run-curate.sh
usage: ./curate.py feed_name_or_url
There is an example crontab line included if you would like to run the script periodically. To avoid abuse of your source URL, you should pick some number between 01 and 59 for the minutes to avoid slamming them.
- Prune entries that are older than a month.
- Allow different persistence options.
- Allow list/multiple feeds from command line.