artheroes.de
robots.txt

Robots Exclusion Standard data for artheroes.de

Resource Scan

Scan Details

Site Domain artheroes.de
Base Domain artheroes.de
Scan Status Ok
Last Scan2024-10-03T11:09:59+00:00
Next Scan 2024-10-17T11:09:59+00:00

Last Scan

Scanned2024-10-03T11:09:59+00:00
URL https://artheroes.de/robots.txt
Redirect https://www.artheroes.de/robots.txt
Redirect Domain www.artheroes.de
Redirect Base artheroes.de
Domain IPs 81.171.24.160
Redirect IPs 81.171.24.160
Response IP 81.171.24.160
Found Yes
Hash a80fad79daa8f8c0b537139a9324c5f9840493213bc45a6ab1b1dcde3b9cc536
SimHash 6304880063b4

Groups

*

Rule Path
Disallow /_debug/
Disallow /ajax/
Disallow /cache/
Disallow /dev/
Disallow /feeds/
Disallow /nl/Recent-bekeken/475
Disallow /bol/
Disallow /*/ShareApp/500/*

adscanner

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.werkaandemuur.nl/sitemap.xml