foodstorys.online
robots.txt
Robots Exclusion Standard data for foodstorys.online
Resource Scan
Scan Details
| Site Domain | foodstorys.online |
| Base Domain | foodstorys.online |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-07-02T09:14:06+00:00 |
| Next Scan | 2024-09-30T09:14:06+00:00 |
Last Successful Scan
| Scanned | 2022-05-13T08:42:43+00:00 |
| URL | https://foodstorys.online/robots.txt |
| Redirect | https://www.foodstorys.online/robots.txt |
| Redirect Domain | www.foodstorys.online |
| Redirect Base | foodstorys.online |
| Response IP | 172.217.194.121 |
| Found | Yes |
| Hash | 93c3f40b9b0bb44e991176008df3b182eb60d9e2692ca865f962e5a6bfe0b4fc |
| SimHash | 494496465711 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /p/about.html |
| Disallow | /p/contact.html |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://foodstorys.online/sitemap.xml |