Log In Sign Up

motor-cdn.prensaiberica.es
robots.txt

Robots Exclusion Standard data for motor-cdn.prensaiberica.es

Resource Scan

Scan Details

Site Domain motor-cdn.prensaiberica.es
Base Domain prensaiberica.es
Scan Status Ok
Last Scan2024-05-25T20:23:04+00:00
Next Scan 2024-06-24T20:23:04+00:00

Last Scan

Scanned2024-05-25T20:23:04+00:00
URL https://motor-cdn.prensaiberica.es/robots.txt
Domain IPs 199.232.194.133, 199.232.198.133
Response IP 146.75.94.133
Found Yes
Hash cc01a3658ddf4f22aee5e0453de6b05b52b5fce994556132c6214c371626cbd1
SimHash d0058222f111

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Rule Path
Disallow /
Back to top

Comments

  • User-agent: *
  • Allow: /
Back to top