static.werkaandemuur.nl
robots.txt

Robots Exclusion Standard data for static.werkaandemuur.nl

Resource Scan

Scan Details

Site Domain static.werkaandemuur.nl
Base Domain werkaandemuur.nl
Scan Status Ok
Last Scan2024-11-04T05:40:31+00:00
Next Scan 2024-11-18T05:40:31+00:00

Last Scan

Scanned2024-11-04T05:40:31+00:00
URL https://static.werkaandemuur.nl/robots.txt
Domain IPs 108.156.133.119, 108.156.133.123, 108.156.133.15, 108.156.133.70, 2600:9000:2755:1a00:4:fedc:e400:93a1, 2600:9000:2755:2a00:4:fedc:e400:93a1, 2600:9000:2755:4c00:4:fedc:e400:93a1, 2600:9000:2755:600:4:fedc:e400:93a1, 2600:9000:2755:6200:4:fedc:e400:93a1, 2600:9000:2755:6e00:4:fedc:e400:93a1, 2600:9000:2755:8800:4:fedc:e400:93a1, 2600:9000:2755:9e00:4:fedc:e400:93a1
Response IP 108.156.133.15
Found Yes
Hash a80fad79daa8f8c0b537139a9324c5f9840493213bc45a6ab1b1dcde3b9cc536
SimHash 6304880063b4

Groups

*

Rule Path
Disallow /_debug/
Disallow /ajax/
Disallow /cache/
Disallow /dev/
Disallow /feeds/
Disallow /nl/Recent-bekeken/475
Disallow /bol/
Disallow /*/ShareApp/500/*

adscanner

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.werkaandemuur.nl/sitemap.xml