benjerry.com
robots.txt

Robots Exclusion Standard data for benjerry.com

Resource Scan

Scan Details

Site Domain benjerry.com
Base Domain benjerry.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-13T04:15:30+00:00
Next Scan 2024-10-11T04:15:30+00:00

Last Successful Scan

Scanned2023-08-26T00:40:11+00:00
URL https://benjerry.com/robots.txt
Redirect https://www.benjerry.com/robots.txt
Redirect Domain www.benjerry.com
Redirect Base benjerry.com
Domain IPs 54.208.45.22
Redirect IPs 23.39.14.205
Response IP 23.39.14.205
Found Yes
Hash 3e2ca8b0b936fdf84544a428be3b12f392709329dea147e57f24b5a0c73ed8a2
SimHash 09451850c513

Groups

*

Rule Path
Allow /
Disallow /sites/us/us-test-shop*

Other Records

Field Value
sitemap https://www.benjerry.com/sitemap.xml