herviewfromhome.com
robots.txt

Robots Exclusion Standard data for herviewfromhome.com

Resource Scan

Scan Details

Site Domain herviewfromhome.com
Base Domain herviewfromhome.com
Scan Status Ok
Last Scan2024-11-13T06:26:14+00:00
Next Scan 2024-11-20T06:26:14+00:00

Last Scan

Scanned2024-11-13T06:26:14+00:00
URL https://herviewfromhome.com/robots.txt
Domain IPs 104.26.4.220, 104.26.5.220, 172.67.74.217, 2606:4700:20::681a:4dc, 2606:4700:20::681a:5dc, 2606:4700:20::ac43:4ad9
Response IP 172.67.74.217
Found Yes
Hash 647271e19cbc4544d78d36780a7928081611dbdff950b9b0c50ad910f3b82fb6
SimHash 2418c9c06795

Groups

*

Rule Path
Allow /*?v
Disallow /calendar/action*
Disallow /events/action*
Disallow /*?

Other Records

Field Value
crawl-delay 3

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Comments

  • Default Flywheel robots file