insidelacrosse.com
robots.txt

Robots Exclusion Standard data for insidelacrosse.com

Resource Scan

Scan Details

Site Domain insidelacrosse.com
Base Domain insidelacrosse.com
Scan Status Ok
Last Scan2024-11-15T17:01:51+00:00
Next Scan 2024-11-22T17:01:51+00:00

Last Scan

Scanned2024-11-15T17:01:51+00:00
URL https://insidelacrosse.com/robots.txt
Redirect https://www.insidelacrosse.com/robots.txt
Redirect Domain www.insidelacrosse.com
Redirect Base insidelacrosse.com
Domain IPs 18.161.97.10, 18.161.97.11, 18.161.97.78, 18.161.97.80
Redirect IPs 104.22.46.180, 104.22.47.180, 172.67.25.228, 2606:4700:10::6816:2eb4, 2606:4700:10::6816:2fb4, 2606:4700:10::ac43:19e4
Response IP 104.22.47.180
Found Yes
Hash a7ef57370ef960afb387d7951769b8a8b618045ff3268814900c2e0ad2496b2a
SimHash c855dc91f5c5

Groups

duckduckbot
googlebot
googlebot-image
mediapartners-google*
slurp
twitterbot
yahoo-mmcrawler
facebot
facebookexternalhit
ia_archiver
msnbot
peer39_crawler

Rule Path
Disallow

*

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1