calorieking.com.au
robots.txt

Robots Exclusion Standard data for calorieking.com.au

Resource Scan

Scan Details

Site Domain calorieking.com.au
Base Domain calorieking.com.au
Scan Status Ok
Last Scan2024-11-09T21:58:59+00:00
Next Scan 2024-11-16T21:58:59+00:00

Last Scan

Scanned2024-11-09T21:58:59+00:00
URL https://calorieking.com.au/robots.txt
Redirect https://www.calorieking.com/robots.txt
Redirect Domain www.calorieking.com
Redirect Base calorieking.com
Domain IPs 104.21.57.85, 172.67.161.145, 2606:4700:3033::6815:3955, 2606:4700:3036::ac43:a191
Redirect IPs 104.21.14.29, 172.67.157.170, 2606:4700:3032::6815:e1d, 2606:4700:3035::ac43:9daa
Response IP 172.67.157.170
Found Yes
Hash 65b9ea956d05638b94f919034a5855ead054fcf32ced64fa1e56d57478ede123
SimHash 51b40c4463e3

Groups

googlebot
bingbot

Rule Path
Disallow /au/en/foods/search?keywords=*
Disallow /gb/en/foods/search?keywords=*
Disallow /us/en/foods/search?keywords=*
Disallow /us/es/foods/search?keywords=*
Disallow /recipes/email.php