Log In Sign Up

fp-informatica.es
robots.txt

Robots Exclusion Standard data for fp-informatica.es

Resource Scan

Scan Details

Site Domain fp-informatica.es
Base Domain fp-informatica.es
Scan Status Ok
Last Scan2025-10-27T21:06:11+00:00
Next Scan 2025-11-03T21:06:11+00:00

Last Scan

Scanned2025-10-27T21:06:11+00:00
URL https://fp-informatica.es/robots.txt
Redirect https://www.fp-informatica.es/robots.txt
Redirect Domain www.fp-informatica.es
Redirect Base fp-informatica.es
Domain IPs 69.6.192.18
Redirect IPs 69.6.192.18
Response IP 69.6.192.18
Found Yes
Hash 93aa18d6a483451bdf56b3077c9ca482d5f00bdd9de7da816d33803aed19c0f8
SimHash 64c79ee20303

Groups

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

mozilla/5.0(compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

*

Rule Path
Disallow /changelog/

*

Rule Path
Disallow /foro/masquerade/
Disallow /foro/u/
Disallow /foro/atom/
Disallow /foro/feed.php
Disallow /foro/memberlist.php
Disallow /foro/ucp.php
Disallow /gymkhana/
Back to top

Comments

  • Baiduspider
  • Changelog
  • Exclude users and legacy routes
Back to top

Warnings

  • 6 invalid lines.
Back to top