islavalefc.com
robots.txt

Robots Exclusion Standard data for islavalefc.com

Resource Scan

Scan Details

Site Domain islavalefc.com
Base Domain islavalefc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-08T09:10:50+00:00
Next Scan 2025-11-07T09:10:50+00:00

Last Successful Scan

Scanned2025-08-17T05:03:07+00:00
URL https://islavalefc.com/robots.txt
Redirect https://www.islavalefc.com/robots.txt
Redirect Domain www.islavalefc.com
Redirect Base islavalefc.com
Domain IPs 185.151.30.148, 2a07:7800::148
Redirect IPs 185.151.30.148, 2a07:7800::148
Response IP 185.151.30.148
Found Yes
Hash 65a4fb3e642e06c31a05c9ce289f2dc2d1690444ac03f24671ede46293223761
SimHash 6042d0175490

Groups

googlebot

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

bingbot

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

teoma

Product Comment
teoma (Ask/Teoma)
Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

facebookexternalhit

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /images/
Disallow /img/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

ia_archiver

Rule Path
Disallow /_notes/
Disallow /cp/
Disallow /phpmailer/

Other Records

Field Value
crawl-delay 20

tweetmemebot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow
Allow /img/

*

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

webalta crawler

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

Comments

  • robots.txt originally generated at http://www.mcanerin.com
  • These are not needed but keep for reference