A simple Twitter fetcher which compresses and dumps the downloads using lzo.
- The Twitter streaming process can be monitored by the main process.
- The fetcher can be stopped safely (e.g. closing all the files/streams) at run-time by setting safe_stop=True in config file.
- It supports hourly file rotation for data dumps.
- The downloaded data is compressed at run-time using lzop which is a very fast (de)compressor.
- The program either restarts every hour or in case of no new tweets within sleep_time seconds.