Log In Sign Up

cosmix.es
robots.txt

Robots Exclusion Standard data for cosmix.es

Resource Scan

Scan Details

Site Domain cosmix.es
Base Domain cosmix.es
Scan Status Ok
Last Scan2025-04-06T19:54:41+00:00
Next Scan 2025-04-13T19:54:41+00:00

Last Scan

Scanned2025-04-06T19:54:41+00:00
URL https://cosmix.es/robots.txt
Redirect https://www.cosmix.es/robots.txt
Redirect Domain www.cosmix.es
Redirect Base cosmix.es
Domain IPs 104.21.74.92, 172.67.201.17, 2606:4700:3034::6815:4a5c, 2606:4700:3035::ac43:c911
Redirect IPs 104.21.74.92, 172.67.201.17, 2606:4700:3034::6815:4a5c, 2606:4700:3035::ac43:c911
Response IP 104.21.74.92
Found Yes
Hash 43afff64c6a573ba579192a7614a6eb720aa316576155d08c0a2e49593985bab
SimHash 29169861f1d0

Groups

*

Rule Path
Disallow /admin

adsbot-google

Rule Path
Disallow /admin

nutch

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap /sitemaps.xml
Back to top

Comments

  • Google adsbot ignores robots.txt unless specifically named!
Back to top