werkaandemuur.nl
robots.txt

Robots Exclusion Standard data for werkaandemuur.nl

Resource Scan

Scan Details

Site Domain werkaandemuur.nl
Base Domain werkaandemuur.nl
Scan Status Ok
Last Scan2024-11-04T16:12:05+00:00
Next Scan 2024-11-18T16:12:05+00:00

Last Scan

Scanned2024-11-04T16:12:05+00:00
URL https://werkaandemuur.nl/robots.txt
Redirect https://www.werkaandemuur.nl/robots.txt
Redirect Domain www.werkaandemuur.nl
Redirect Base werkaandemuur.nl
Domain IPs 81.171.24.160
Redirect IPs 81.171.24.160
Response IP 81.171.24.160
Found Yes
Hash a80fad79daa8f8c0b537139a9324c5f9840493213bc45a6ab1b1dcde3b9cc536
SimHash 6304880063b4

Groups

*

Rule Path
Disallow /_debug/
Disallow /ajax/
Disallow /cache/
Disallow /dev/
Disallow /feeds/
Disallow /nl/Recent-bekeken/475
Disallow /bol/
Disallow /*/ShareApp/500/*

adscanner

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.werkaandemuur.nl/sitemap.xml