insidelacrosse.com
robots.txt

Robots Exclusion Standard data for insidelacrosse.com

Resource Scan

Scan Details

Site Domain insidelacrosse.com
Base Domain insidelacrosse.com
Scan Status Ok
Last Scan2024-05-24T12:07:50+00:00
Next Scan 2024-05-31T12:07:50+00:00

Last Scan

Scanned2024-05-24T12:07:50+00:00
URL https://insidelacrosse.com/robots.txt
Redirect https://www.insidelacrosse.com/robots.txt
Redirect Domain www.insidelacrosse.com
Redirect Base insidelacrosse.com
Domain IPs 18.155.192.20, 18.155.192.28, 18.155.192.54, 18.155.192.71
Redirect IPs 104.22.46.180, 104.22.47.180, 172.67.25.228, 2606:4700:10::6816:2eb4, 2606:4700:10::6816:2fb4, 2606:4700:10::ac43:19e4
Response IP 104.22.47.180
Found Yes
Hash fdc31d5a7a2e956fd832e1651903260f87ca6936fae51030a65ac1ce8a1d3a8b
SimHash e810dc93f5c5

Groups

googlebot
slurp
msnbot
mediapartners-google*
googlebot-image
yahoo-mmcrawler
duckduckbot
facebot
facebookexternalhit
ia_archiver
twitterbot

Rule Path
Disallow

*

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1