duuren.weebly.com
robots.txt

Robots Exclusion Standard data for duuren.weebly.com

Resource Scan

Scan Details

Site Domain duuren.weebly.com
Base Domain weebly.com
Scan Status Ok
Last Scan2024-10-08T17:50:40+00:00
Next Scan 2024-11-07T17:50:40+00:00

Last Scan

Scanned2024-10-08T17:50:40+00:00
URL https://duuren.weebly.com/robots.txt
Domain IPs 74.115.51.8, 74.115.51.9
Response IP 74.115.51.8
Found Yes
Hash dfcb3fb2b1889474c6b7c80fc8be19e0ffa84a58451635b7ad48b34a9a14d0f3
SimHash 9854c04c2312

Groups

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /bvlgd-duuren.html
Disallow /bvlgd-duuren---foto.html
Disallow /bvlgd-duuren---foto-1ste-shoot.html
Disallow /bvlgd-duuren---foto-2de-shoot.html
Disallow /bvlgd-duuren---foto-3de-shoot.html
Disallow /bvlgd-duuren---foto-4de-shoot.html
Disallow /bvlgd-duuren---foto-5de-shoot.html
Disallow /bvlgd-duuren---foto-6de-shoot.html
Disallow /bvlgd-duuren---foto-7ste-shoot.html
Disallow /bvlgd-duuren---foto-8ste-shoot.html
Disallow /bvlgd-duuren---foto-9de-shoot.html
Disallow /bvlgd-duuren---foto-10de-shoot.html
Disallow /bvlgd-duuren---fotos-dolhuys.html
Disallow /bvlgd-duuren---fotos-leegstaande-ruimtes.html
Disallow /bvlgd-duuren---fotos-uit-de-oude-doos.html
Disallow /bvlgd-duuren---fotos-histaruz.html
Disallow /bvlgd-duuren---fotos-middle-gate-geel-2013.html
Disallow /bvlgd-duuren---fotos-anderen.html
Disallow /bvlgd-duuren---film.html
Disallow /bvlgd-duuren---verhalen.html
Disallow /bvlgd-duuren---download.html

Other Records

Field Value
sitemap http://duuren.weebly.com/sitemap.xml