Log In Sign Up

define.com
robots.txt

Robots Exclusion Standard data for define.com

Resource Scan

Scan Details

Site Domain define.com
Base Domain define.com
Scan Status Ok
Last Scan2024-06-27T10:12:39+00:00
Next Scan 2024-07-27T10:12:39+00:00

Last Scan

Scanned2024-06-27T10:12:39+00:00
URL https://define.com/robots.txt
Domain IPs 3.165.102.128, 3.165.102.39, 3.165.102.59, 3.165.102.65
Response IP 3.165.102.39
Found Yes
Hash 9dfcff5bdba2e58773b20608932cffc6c0c6dd3bc75fd9f5b3cc9282d4e7aa52
SimHash 05444600d371

Groups

ia_archiver
surveybot
findestars
myonid
peekyou
pipl
panscient.com
rapleaf
snitch
spock
tweepz
wink
yasni
yoname
yourtraces
zoominfo

Rule Path
Disallow /

*

Rule Path
Allow /$
Allow /EXECUTIVE-SUMMARY.html
Disallow /
Back to top

Warnings

  • 1 invalid line.
Back to top