ipt-forensics.com
robots.txt

Robots Exclusion Standard data for ipt-forensics.com

Resource Scan

Scan Details

Site Domain ipt-forensics.com
Base Domain ipt-forensics.com
Scan Status Ok
Last Scan2025-08-16T18:45:18+00:00
Next Scan 2025-09-15T18:45:18+00:00

Last Scan

Scanned2025-08-16T18:45:18+00:00
URL http://ipt-forensics.com/robots.txt
Domain IPs 66.175.58.9
Response IP 66.175.58.9
Found Yes
Hash e12fa6e5eb5e4119200614481ddd5d68d490cc49de9923629eb2ff7d29752285
SimHash 2840d8909283

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /images/
Disallow /group/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

teoma

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

aipbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

psbot

Rule Path
Disallow /