carlosmota.eu
robots.txt

Robots Exclusion Standard data for carlosmota.eu

Resource Scan

Scan Details

Site Domain carlosmota.eu
Base Domain carlosmota.eu
Scan Status Ok
Last Scan2025-06-17T21:43:59+00:00
Next Scan 2025-06-24T21:43:59+00:00

Last Scan

Scanned2025-06-17T21:43:59+00:00
URL https://carlosmota.eu/robots.txt
Redirect http://www.carlosmota.eu/robots.txt
Redirect Domain www.carlosmota.eu
Redirect Base carlosmota.eu
Domain IPs 104.21.41.203, 172.67.167.36, 2606:4700:3035::6815:29cb, 2606:4700:3035::ac43:a724
Redirect IPs 104.21.41.203, 172.67.167.36, 2606:4700:3035::6815:29cb, 2606:4700:3035::ac43:a724
Response IP 104.21.41.203
Found Yes
Hash 5afed99552e89b2230a87161672e51d14dc66dfafc134c8b75c2be6de46d2fa8
SimHash 9056f9e5b7b3

Groups

*

Rule Path
Disallow /ajaxed/
Disallow /ajaxedConfig/
Disallow /ajaxedLogs/
Disallow /audio/
Disallow /ckeditor/
Disallow /css/
Disallow /css-dev/
Disallow /fonts/
Disallow /gallery/
Disallow /guestbook/backend/
Disallow /guestbook/CAPTCHA/
Disallow /guestbook/functions/
Disallow /guestbook/includes/
Disallow /guestbook/js/
Disallow /images/
Disallow /js/
Disallow /js-dev/
Disallow /mmstat/
Disallow /templates/

Other Records

Field Value
sitemap http://www.carlosmota.eu/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • Make changes for all web spiders