androidworld.nl
robots.txt
Robots Exclusion Standard data for androidworld.nl
Resource Scan
Scan Details
| Site Domain | androidworld.nl |
| Base Domain | androidworld.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-08T07:07:22+00:00 |
| Next Scan | 2024-11-15T07:07:22+00:00 |
Last Scan
| Scanned | 2024-11-08T07:07:22+00:00 |
| URL | https://androidworld.nl/robots.txt |
| Domain IPs | 104.26.14.194, 104.26.15.194, 172.67.72.248, 2606:4700:20::681a:ec2, 2606:4700:20::681a:fc2, 2606:4700:20::ac43:48f8 |
| Response IP | 104.26.15.194 |
| Found | Yes |
| Hash | 110463ba26e4fe1f8e2a7bde91c12840e77ae057a3ed4bb92054bde5917b097c |
| SimHash | 4022d58be512 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?action= |
| Disallow | *?remove |
| Disallow | */?categorieen= |
| Disallow | */?merk= |
| Disallow | */?product= |
| Disallow | */?productcategorieen= |
| Disallow | */?themas= |
| Disallow | */?type= |
| Disallow | */archief/ |
| Disallow | /?key=* |
| Disallow | /?rest_route= |
| Disallow | /?s=* |
| Disallow | /go/ |
| Disallow | /naar-shop/ |
| Disallow | /naar-winkel/ |
| Disallow | /out/ |
| Disallow | /pagina/ |
| Disallow | /search/ |
| Disallow | /wp-content/themes/bigspark/ajax/comment-count.php |
| Disallow | /wp-content/themes/bigspark/ajax/device-url.php |
| Disallow | /wp-content/themes/bigspark/ajax/dynamic-content.php |
| Disallow | /wp-json/ |
| Disallow | /wp/wp-login.php |
| Allow | /community/$ |
| Disallow | /community/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://androidworld.nl/sitemap_index.xml |
| sitemap | https://androidworld.nl/google-news-sitemap.xml |
| sitemap | https://androidworld.nl/advisor-sitemap.php |
Comments