carldnelson.com
robots.txt
Robots Exclusion Standard data for carldnelson.com
Resource Scan
Scan Details
Site Domain | carldnelson.com |
Base Domain | carldnelson.com |
Scan Status | Ok |
Last Scan | 2025-08-12T21:14:05+00:00 |
Next Scan | 2025-09-11T21:14:05+00:00 |
Last Scan
Scanned | 2025-08-12T21:14:05+00:00 |
URL | http://carldnelson.com/robots.txt |
Domain IPs | 185.151.30.215 |
Response IP | 185.151.30.215 |
Found | Yes |
Hash | c2a65b5a5ae2fbb3c5509f885e99438cf9025ca303c292600cf552d3347a9280 |
SimHash | 6d59de45eb5b |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /is/ |
Disallow | /panos/ |
Disallow | /wp-content-saved/ |
Disallow | /content/feed/ |
Disallow | /content/trackback/ |
Disallow | /content/wp-admin/ |
Disallow | /content/wp-content/ |
Disallow | /content/wp-includes/ |
Disallow | /content/xmlrpc.php |
Disallow | /content/wp- |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |