topgear.nl
robots.txt
Robots Exclusion Standard data for topgear.nl
Resource Scan
Scan Details
Site Domain | topgear.nl |
Base Domain | topgear.nl |
Scan Status | Ok |
Last Scan | 2024-09-21T13:03:40+00:00 |
Next Scan | 2024-09-28T13:03:40+00:00 |
Last Scan
Scanned | 2024-09-21T13:03:40+00:00 |
URL | https://topgear.nl/robots.txt |
Domain IPs | 217.170.16.27 |
Response IP | 217.170.16.27 |
Found | Yes |
Hash | 6bcabe00dfb5e0d52b6b31de9c91ade250483e0850d266fd07decd04e94a0e5a |
SimHash | 49000880c5b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp/wp-admin/ |
Allow | /wp/wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://topgear.nl/sitemap_index.xml |
Comments