formacionsinbarreras.com
robots.txt

Robots Exclusion Standard data for formacionsinbarreras.com

Resource Scan

Scan Details

Site Domain formacionsinbarreras.com
Base Domain formacionsinbarreras.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-11-05T10:13:52+00:00
Next Scan 2025-02-03T10:13:52+00:00

Last Successful Scan

Scanned2023-09-20T04:52:09+00:00
URL https://formacionsinbarreras.com/robots.txt
Redirect https://www.formacionsinbarreras.com/robots.txt
Redirect Domain www.formacionsinbarreras.com
Redirect Base formacionsinbarreras.com
Domain IPs 104.21.19.185, 172.67.187.148, 2606:4700:3030::6815:13b9, 2606:4700:3035::ac43:bb94
Redirect IPs 104.21.19.185, 172.67.187.148, 2606:4700:3030::6815:13b9, 2606:4700:3035::ac43:bb94
Response IP 104.21.19.185
Found Yes
Hash 961a968b9487ef4e7e8c29f0d9bebf367b1cd9aea67c07986c054c028b0c5812
SimHash 2951a3754691

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Allow /amp

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

yahoo pipes 1.0

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-news

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

zyborg

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

architextspider

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://formacionsinbarreras.com/sitemap.xml

Warnings

  • 2 invalid lines.