crictracker.com
robots.txt

Robots Exclusion Standard data for crictracker.com

Resource Scan

Scan Details

Site Domain crictracker.com
Base Domain crictracker.com
Scan Status Ok
Last Scan2024-05-19T13:42:40+00:00
Next Scan 2024-05-26T13:42:40+00:00

Last Scan

Scanned2024-05-19T13:42:40+00:00
URL https://crictracker.com/robots.txt
Redirect https://www.crictracker.com:443/robots.txt
Redirect Domain www.crictracker.com
Redirect Base crictracker.com
Domain IPs 52.66.171.246, 65.2.0.21
Redirect IPs 104.26.14.31, 104.26.15.31, 172.67.71.184, 2606:4700:20::681a:e1f, 2606:4700:20::681a:f1f, 2606:4700:20::ac43:47b8
Response IP 172.67.71.184
Found Yes
Hash b4d5b84250c89485c2a08b4af1d1966c8c0249a2a80385f0cd7934fd4ac46003
SimHash 010c9a60ca13

Groups

*

Rule Path
Allow /
Allow /.well-known/amphtml/apikey.pub

grapeshot

Rule Path
Disallow

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.crictracker.com/sitemap.xml
sitemap https://www.crictracker.com/news-sitemap.xml