animalvivid.com
robots.txt

Robots Exclusion Standard data for animalvivid.com

Resource Scan

Scan Details

Site Domain animalvivid.com
Base Domain animalvivid.com
Scan Status Ok
Last Scan4/8/2025, 5:21:15 AM
Next Scan 4/15/2025, 5:21:15 AM

Last Scan

Scanned4/8/2025, 5:21:15 AM
URL https://animalvivid.com/robots.txt
Domain IPs 104.21.56.129, 172.67.151.47, 2606:4700:3032::6815:3881, 2606:4700:3037::ac43:972f
Response IP 172.67.151.47
Found Yes
Hash 9c37782ded2572b5769540aa184c91d6c78cd8430ef7129774ad6c924febe6f7
SimHash 694ac0d4c791

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /

criteo-crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

comscore web-crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30