booksnreview.com
robots.txt
Robots Exclusion Standard data for booksnreview.com
Resource Scan
Scan Details
Site Domain | booksnreview.com |
Base Domain | booksnreview.com |
Scan Status | Ok |
Last Scan | 2024-11-04T17:06:37+00:00 |
Next Scan | 2024-11-11T17:06:37+00:00 |
Last Scan
Scanned | 2024-11-04T17:06:37+00:00 |
URL | https://booksnreview.com/robots.txt |
Redirect | https://www.booksnreview.com/robots.txt |
Redirect Domain | www.booksnreview.com |
Redirect Base | booksnreview.com |
Domain IPs | 34.111.27.229 |
Redirect IPs | 34.111.27.229 |
Response IP | 34.111.27.229 |
Found | Yes |
Hash | 72782ec35ee139126670fbd7e82326d53cbe80581b67e191c06dc8afea9eed34 |
SimHash | dd4c0d05cd11 |
Groups
*
Rule | Path |
---|---|
Disallow | /art/ |
Disallow | /views/ |
Disallow | /home/ |
Disallow | /check_mobile.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.booksnreview.com/sitemap.xml |
sitemap | https://www.booksnreview.com/sitemap.php |