es-blog.it
robots.txt

Robots Exclusion Standard data for es-blog.it

Resource Scan

Scan Details

Site Domain es-blog.it
Base Domain es-blog.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-04-23T01:49:49+00:00
Next Scan 2024-06-22T01:49:49+00:00

Last Successful Scan

Scanned2024-02-24T01:48:21+00:00
URL https://es-blog.it/robots.txt
Domain IPs 88.99.4.156
Response IP 88.99.4.156
Found Yes
Hash 31e87044edd8d8f3027fe0e9c2e17b956a54de272240c4e0b3c50be6ce0c22ef
SimHash e83cd9437c10

Groups

*

Rule Path
Disallow /*add-to-cart%3D*
Disallow /feed/
Disallow */feed
Disallow */feed$
Disallow /feed/$
Disallow /comments/feed
Disallow /?feed=
Disallow /wp-feed

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://es-blog.it/sitemaps.xml

Warnings

  • `​user-agent` is not a known field.