A wizard that brings old files!
wb requires go1.17 to install successfully. Run the following command to get the repo -
go install github.com/riza/wb@latestecho "https://akamai.airbnb.com/robots.txt"|wb wb https://akamai.airbnb.com/robots.txtUsage:
wb [flags]
-u
specify url
-t
specift http timeout
-all
get all snapshots
-date string
get snapshot for a specific date
-no-banner
hide banner
-snapshots
get all snapshots
-help
show help