giveusthisday.org
robots.txt
Robots Exclusion Standard data for giveusthisday.org
Resource Scan
Scan Details
Site Domain | giveusthisday.org |
Base Domain | giveusthisday.org |
Scan Status | Ok |
Last Scan | 2024-09-30T10:43:09+00:00 |
Next Scan | 2024-10-30T10:43:09+00:00 |
Last Scan
Scanned | 2024-09-30T10:43:09+00:00 |
URL | https://giveusthisday.org/robots.txt |
Domain IPs | 52.240.139.241 |
Response IP | 52.240.139.241 |
Found | Yes |
Hash | 85a582c9551a9d32b2fe94d88d15cfd369f55908dee7b303fc0dc7b29ed56e1b |
SimHash | 0b7973498c23 |
Groups
*
Rule | Path |
---|---|
Disallow | /Cart/ |
Disallow | /Register/ |
Disallow | /Products/Search |
Disallow | /MyAccount/ |
Disallow | /Preview/ |
Disallow | /Basket/ |
Disallow | /Books/ |
Disallow | /Products/GetImage/ |
Disallow | /Digital/Speak |
Disallow | /Digital/read |
Disallow | /CW/ |
Disallow | /RequestCopy |
Disallow | /Products/ |
Disallow | /CurrentSeasonProducts |
Disallow | /Subscribe/Index |
Disallow | /api/* |
Disallow | /Products/* |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://giveusthisday.org/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments