define.com
robots.txt

Robots Exclusion Standard data for define.com

Resource Scan

Scan Details

Site Domain define.com
Base Domain define.com
Scan Status Ok
Last Scan2024-10-25T10:13:40+00:00
Next Scan 2024-11-24T10:13:40+00:00

Last Scan

Scanned2024-10-25T10:13:40+00:00
URL https://define.com/robots.txt
Domain IPs 3.165.102.128, 3.165.102.39, 3.165.102.59, 3.165.102.65
Response IP 3.165.102.65
Found Yes
Hash 9dfcff5bdba2e58773b20608932cffc6c0c6dd3bc75fd9f5b3cc9282d4e7aa52
SimHash 05444600d371

Groups

ia_archiver
surveybot
findestars
myonid
peekyou
pipl
panscient.com
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

*

Rule Path
Allow /$
Allow /EXECUTIVE-SUMMARY.html
Disallow /

Warnings

  • 1 invalid line.