bit.nl
robots.txt
Robots Exclusion Standard data for bit.nl
Resource Scan
Scan Details
| Site Domain | bit.nl |
| Base Domain | bit.nl |
| Scan Status | Ok |
| Last Scan | 2025-11-02T04:17:57+00:00 |
| Next Scan | 2025-11-16T04:17:57+00:00 |
Last Scan
| Scanned | 2025-11-02T04:17:57+00:00 |
| URL | https://bit.nl/robots.txt |
| Redirect | https://www.bit.nl/robots.txt |
| Redirect Domain | www.bit.nl |
| Redirect Base | bit.nl |
| Domain IPs | 2001:7b8:3:5::80:20, 213.136.12.98 |
| Redirect IPs | 2001:7b8:3:5::80:20, 213.136.12.98 |
| Response IP | 213.136.12.98 |
| Found | Yes |
| Hash | a521901ef684da37da6c4c3c3c15b2611d695155684eb385995d56b890a117e4 |
| SimHash | 180148c0c533 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp/wp-admin/ |
| Allow | /wp/wp-admin/admin-ajax.php |
*
| Rule | Path |
|---|---|
| Disallow | /wp-json/ |
| Disallow | /?rest_route= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bit.nl/sitemap_index.xml |
Comments