Log In Sign Up

concourschanceux.com
robots.txt

Robots Exclusion Standard data for concourschanceux.com

Resource Scan

Scan Details

Site Domain concourschanceux.com
Base Domain concourschanceux.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T03:49:22+00:00
Next Scan 2024-12-16T03:49:22+00:00

Last Successful Scan

Scanned2024-03-24T17:59:22+00:00
URL https://concourschanceux.com/robots.txt
Domain IPs 104.21.4.149, 172.67.154.49, 2606:4700:3030::6815:495, 2606:4700:3032::ac43:9a31
Response IP 172.67.154.49
Found Yes
Hash 7fb573fc0d345c7bc2a16304bb551a716f908b24a9caf84825b8c0b28c3b00b0
SimHash 663ddac071d3

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /wp-content/uploads/

applebot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /wp-content/uploads/

slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /

baiduspider-image

Rule Path
Allow /wp-content/uploads/

duckduckbot

Rule Path
Allow /

qwantify

Rule Path
Allow /

dotbot

Rule Path
Disallow /

giftghostbot

Rule Path
Disallow /

seznam

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

dataprovider/6.101

Rule Path
Disallow /

dataprovidersiteexplorer

Rule Path
Disallow /

dazoobot/1.0

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

domainstatsbot/1.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

dubaiindex

Rule Path
Disallow /

ecommercebot

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

feedbin

Rule Path
Disallow /

fetch/2.0a

Rule Path
Disallow /

ffbot/1.0

Rule Path
Disallow /

focusbot/1.1

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

huaweisymantecspider/1.0

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

lipperheylinkexplorer

Rule Path
Disallow /

lssrocketcrawler/1.0

Rule Path
Disallow /

lyt.srv1.5

Rule Path
Disallow /

miadev/0.0.1

Rule Path
Disallow /

najdi.si/3.1

Rule Path
Disallow /

bountiibot

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://concourschanceux.com/sitemap_index.xml
Back to top

Comments

  • Block Bad Bots. Powered by Better Robots.txt Pro
  • This robots.txt file was created by Better Robots.txt (Index & Rank Booster by Pagup) Plugin. https://agenceseo.ca/
Back to top