Robots.txt should be editable, even when the "physical" file doesn't exist

[jdevalk]

There is a filter that allows for modifying the output so we could just store as an option, would also be great for multi site.

[jdevalk]

Related to #137

[jrfnl]

Looks like you added this enhancement in commit 0799abb . Is that right ? We should add it to the changelog in readme.txt and close the issue.

[jdevalk]

Yes and no... You can now create the robots.txt file, but in the long run we should do this even better, because on multisite, creating it might actually give issues...

[atimmer]

Closing, if it is important enough it can be reopened.

[jdevalk]

I deem it important enough. I think this'd actually be very useful and a relatively simple thing to build.

[mariusghitulescu]

I can still reproduce the issue.

1. I deleted the physical robots.txt file
2. I installed the Clearfy plugin and created a robots.txt file (in Settings → Clearfly Menu → SEO)
3. I checked the robots.txt file in SEO → Tools → File Editor. It doesn't detect it.
   
4. I checked the website's robots.txt file using the URL, it shows the data I've set with Clearfy
   

The issue could probably be reproduced by any other solution that doesn't create a physical robots.txt file, I used Clearfy as I was already familiar with it.