Log In Sign Up

fancons.ca
robots.txt

Robots Exclusion Standard data for fancons.ca

Resource Scan

Scan Details

Site Domain fancons.ca
Base Domain fancons.ca
Scan Status Ok
Last Scan2024-11-12T22:48:00+00:00
Next Scan 2024-11-19T22:48:00+00:00

Last Scan

Scanned2024-11-12T22:48:00+00:00
URL https://fancons.ca/robots.txt
Domain IPs 104.21.80.40, 172.67.174.15, 2606:4700:3031::ac43:ae0f, 2606:4700:3037::6815:5028
Response IP 172.67.174.15
Found Yes
Hash 42e47d52fcef77603aa248f5e14c342eaac189fd58a281f0dd8ad5638fbb2d1d
SimHash c23c5063e239

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

bytespider | byte spider | bytedance | bytedance

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

ias_wombles

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

moget

Rule Path
Disallow /

proximic

Rule Path
Disallow /

voyager

Rule Path
Disallow /

*

Rule Path
Disallow /advertising
Disallow /cgi-bin
Disallow /contact
Disallow /events/update/
Disallow /home/ads
Disallow /podcast
Disallow /store
Disallow /widgets
Disallow /x/px
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$
Disallow /members/history/searchcons.php

Other Records

Field Value
crawl-delay 1.5
Back to top

Other Records

Field Value
sitemap https://fancons.ca/sitemaps/sitemap-fcca.xml
Back to top