Log In Sign Up

sportuitslagen.org
robots.txt

Robots Exclusion Standard data for sportuitslagen.org

Resource Scan

Scan Details

Site Domain sportuitslagen.org
Base Domain sportuitslagen.org
Scan Status Ok
Last Scan2024-11-02T12:07:40+00:00
Next Scan 2024-11-09T12:07:40+00:00

Last Scan

Scanned2024-11-02T12:07:40+00:00
URL https://sportuitslagen.org/robots.txt
Redirect https://www.sportuitslagen.org/robots.txt
Redirect Domain www.sportuitslagen.org
Redirect Base sportuitslagen.org
Domain IPs 104.21.75.138, 172.67.177.119, 2606:4700:3032::ac43:b177, 2606:4700:3035::6815:4b8a
Redirect IPs 104.21.75.138, 172.67.177.119, 2606:4700:3032::ac43:b177, 2606:4700:3035::6815:4b8a
Response IP 172.67.177.119
Found Yes
Hash 5f5e890d2ce3d505f217b0f73629ca6b24517cf859c18f6e56467bdb6c161049
SimHash 2a579c80c21f

Groups

mediapartners-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /accueil.php
Disallow /index.php
Disallow /admin.php
Disallow /calendrier.php
Disallow /tmp/
Disallow /images/_bleu_elec
Disallow /images/boutons
Disallow /img/graph
Disallow /zz
Disallow /how-to-

linguee bot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

vegebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ezoicbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

screaming frog seo spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • Disallow: /television_
Back to top