planetware.com
robots.txt

Robots Exclusion Standard data for planetware.com

Resource Scan

Scan Details

Site Domain planetware.com
Base Domain planetware.com
Scan Status Ok
Last Scan2024-09-18T12:07:05+00:00
Next Scan 2024-09-25T12:07:05+00:00

Last Scan

Scanned2024-09-18T12:07:05+00:00
URL https://planetware.com/robots.txt
Domain IPs 13.225.4.103, 13.225.4.17, 13.225.4.23, 13.225.4.48, 2600:9000:21b4:2600:c:924b:b580:93a1, 2600:9000:21b4:3400:c:924b:b580:93a1, 2600:9000:21b4:6a00:c:924b:b580:93a1, 2600:9000:21b4:7200:c:924b:b580:93a1, 2600:9000:21b4:b600:c:924b:b580:93a1, 2600:9000:21b4:b800:c:924b:b580:93a1, 2600:9000:21b4:ea00:c:924b:b580:93a1, 2600:9000:21b4:ee00:c:924b:b580:93a1
Response IP 13.225.4.17
Found Yes
Hash 11b692a50a38bae7028a4e60892f4ed4a5f07dc645e786df5f423a1a408ac4f4
SimHash 6213d5364455

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dhoondho.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

charlotte

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4