infurma.es
robots.txt

Robots Exclusion Standard data for infurma.es

Resource Scan

Scan Details

Site Domain infurma.es
Base Domain infurma.es
Scan Status Ok
Last Scan2024-11-13T09:10:42+00:00
Next Scan 2024-11-20T09:10:42+00:00

Last Scan

Scanned2024-11-13T09:10:42+00:00
URL https://infurma.es/robots.txt
Redirect https://www.infurma.es/robots.txt
Redirect Domain www.infurma.es
Redirect Base infurma.es
Domain IPs 80.67.99.3
Redirect IPs 80.67.99.3
Response IP 80.67.99.3
Found Yes
Hash ff6209fb7c583fddadd296398b2d1b3ff21e805bf7fd69f7eede972aabf3c4d1
SimHash 28175cf4c093

Groups

*
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

baiduspider

Rule Path
Disallow /admin/
Disallow /functions/
Disallow /css/
Disallow /js/
Disallow /smtp/
Disallow /facturacion/
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 100

Other Records

Field Value
sitemap https://www.infurma.es/sitemap_infurma.xml
sitemap https://www.infurma.es/sitemap_infurma2.xml