roysfarm.com
robots.txt
Robots Exclusion Standard data for roysfarm.com
Resource Scan
Scan Details
Site Domain | roysfarm.com |
Base Domain | roysfarm.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-10-02T04:14:01+00:00 |
Next Scan | 2024-10-09T04:14:01+00:00 |
Last Successful Scan
Scanned | 2024-09-24T04:12:56+00:00 |
URL | https://roysfarm.com/robots.txt |
Domain IPs | 2a02:4780:b:923:0:34a4:aa7d:1, 82.180.128.87 |
Response IP | 82.180.128.87 |
Found | Yes |
Hash | dad6091e1c2e8e967900704e72c8d406a23be628b3fe56eb0891528199f155ad |
SimHash | 48285a418693 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-admin/ |
Disallow | /search/ |
Disallow | /es/search/ |
Disallow | */?s=* |
Disallow | */feed/ |
Disallow | */ajax/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.roysfarm.com/post-sitemap.xml |
sitemap | https://www.roysfarm.com/post-sitemap.html |