exellent.be
robots.txt

Robots Exclusion Standard data for exellent.be

Resource Scan

Scan Details

Site Domain exellent.be
Base Domain exellent.be
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-22T07:59:33+00:00
Next Scan 2024-11-20T07:59:33+00:00

Last Successful Scan

Scanned2022-09-16T00:03:29+00:00
URL https://exellent.be/robots.txt
Redirect https://www.exellent.be/robots.txt
Redirect Domain www.exellent.be
Redirect Base exellent.be
Response IP 185.2.53.123
Found Yes
Hash aa0b388d4afd74b02a0877a5bcda8fa7224d60a52be6fa00cfd17d539157988b
SimHash 4a5c5cc47610

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

yandex

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.exellent.be/sitemap.xml