Log In Sign Up

pethydrationcalc.com
robots.txt

Robots Exclusion Standard data for pethydrationcalc.com

Resource Scan

Scan Details

Site Domain pethydrationcalc.com
Base Domain pethydrationcalc.com
Scan Status Ok
Last Scan2025-09-07T09:44:15+00:00
Next Scan 2025-09-14T09:44:15+00:00

Last Scan

Scanned2025-09-07T09:44:15+00:00
URL https://pethydrationcalc.com/robots.txt
Domain IPs 2a02:4780:84:13f5:63f5:67c1:75d5:ad48, 2a02:4780:84:9fc8:89ca:afcb:56ae:9623, 84.32.84.154, 84.32.84.158
Response IP 93.127.187.0
Found Yes
Hash e4df38604cccbbed6700d88b16ad350e3ad084341316b6942e44c27114158323
SimHash 4d40b912cf91

Groups

*

Rule Path
Allow /
Allow /ads.txt
Disallow /*?*$

adsbot-google

Rule Path
Allow /ads.txt
Disallow

adsbot-google-mobile

Rule Path
Allow /ads.txt
Disallow

googlebot

Rule Path
Allow /ads.txt
Back to top

Other Records

Field Value
sitemap https://pethydrationcalc.com/sitemap.xml
Back to top

Comments

  • /robots.txt
  • Block URLs with query parameters but allow ads.txt explicitly
  • Make sure Google's ads crawlers can fetch pages and ads.txt
Back to top