indianastatefair.com
robots.txt

Robots Exclusion Standard data for indianastatefair.com

Resource Scan

Scan Details

Site Domain indianastatefair.com
Base Domain indianastatefair.com
Scan Status Ok
Last Scan2024-11-28T18:41:50+00:00
Next Scan 2024-12-12T18:41:50+00:00

Last Scan

Scanned2024-11-28T18:41:50+00:00
URL https://indianastatefair.com/robots.txt
Redirect https://www.indianastatefair.com/robots.txt
Redirect Domain www.indianastatefair.com
Redirect Base indianastatefair.com
Domain IPs 13.88.18.55
Redirect IPs 13.88.18.55
Response IP 13.88.18.55
Found Yes
Hash 36465d3502866c150186d1df0a00034e382bbb5f34d2d105489772a17842be88
SimHash 0874dd748293

Groups

baiduspider

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /undefined*
Disallow *I_map.aspx*
Disallow *I_emailevent.aspx*
Disallow *I_emailbusiness.aspx*

Other Records

Field Value
sitemap https://www.indianastatefair.com/sitemap.xml