qweb.nu
robots.txt
Robots Exclusion Standard data for qweb.nu
Resource Scan
Scan Details
Site Domain | qweb.nu |
Base Domain | qweb.nu |
Scan Status | Ok |
Last Scan | 2025-06-24T06:19:45+00:00 |
Next Scan | 2025-07-24T06:19:45+00:00 |
Last Scan
Scanned | 2025-06-24T06:19:45+00:00 |
URL | http://qweb.nu/robots.txt |
Redirect | https://www.qweb.nl/robots.txt |
Redirect Domain | www.qweb.nl |
Redirect Base | qweb.nl |
Domain IPs | 217.18.79.52, 2a00:19c0:c079:51::2 |
Redirect IPs | 138.199.46.68, 2400:52e0:1500::1274:1 |
Response IP | 138.199.24.219 |
Found | Yes |
Hash | 4433eab92ab42250345506fdbe9c6a8c551640adfefb6ae77208a74378b04359 |
SimHash | 2901583487f3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */bestellen/ |
Disallow | */winkelwagen/ |
Disallow | /niet-gevonden/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.qweb.nl/sitemap.xml |