ffsa.org
robots.txt

Robots Exclusion Standard data for ffsa.org

Resource Scan

Scan Details

Site Domain ffsa.org
Base Domain ffsa.org
Scan Status Ok
Last Scan2024-10-27T10:16:38+00:00
Next Scan 2024-11-26T10:16:38+00:00

Last Scan

Scanned2024-10-27T10:16:38+00:00
URL https://ffsa.org/robots.txt
Redirect https://www.ffsa.org/robots.txt
Redirect Domain www.ffsa.org
Redirect Base ffsa.org
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.22, 76.76.21.98
Response IP 76.76.21.93
Found Yes
Hash 8ab0c2f3debcc487d19644486b5970decf9760513e1369310795a6cf80bbe4ab
SimHash 455d8bd74083

Groups

*

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

applebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-mobile

Rule Path
Allow /

baiduspider-video

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /

naverbot

Rule Path
Allow /

y!j-wsc

Rule Path
Allow /

yj-wsc

Rule Path
Allow /

yeti

Rule Path
Allow /

yandex

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandexmobilebot

Rule Path
Allow /

yandexvideo

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexsitelinks

Rule Path
Allow /

seznambot

Rule Path
Allow /

*

Rule Path
Disallow /mon-espace/*

*

Rule Path
Disallow /_next/*

*

Rule Path
Disallow /api/*

*

Rule Path
Disallow /icons/*

Other Records

Field Value
sitemap https://www.ffsa.org/sitemap.xml

Comments

  • *
  • Screaming Frog SEO Spider
  • googlebot
  • Googlebot-Video
  • Applebot
  • bingbot
  • Baiduspider
  • Baiduspider-mobile
  • Baiduspider-video
  • Baiduspider-image
  • NaverBot
  • Y!J-WSC
  • YJ-WSC
  • Yeti
  • Yandex
  • YandexBot
  • YandexMobileBot
  • YandexVideo
  • YandexWebmaster
  • YandexSitelinks
  • SeznamBot
  • *
  • *
  • *
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.