mrglee.com
robots.txt

Robots Exclusion Standard data for mrglee.com

Resource Scan

Scan Details

Site Domain mrglee.com
Base Domain mrglee.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-06T15:20:25+00:00
Next Scan 2024-11-04T15:20:25+00:00

Last Successful Scan

Scanned2024-04-09T14:07:26+00:00
URL http://mrglee.com/robots.txt
Domain IPs 47.99.174.169
Response IP 47.99.174.169
Found Yes
Hash b8bea48db1067e4818870ea69002b18a3fa1a46935c0ecfe3449353dba5c6f8b
SimHash 4d04dc53c631

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://mrglee.com/index.php/sitemap.xml