amsterdive.com
robots.txt
Robots Exclusion Standard data for amsterdive.com
Resource Scan
Scan Details
Site Domain | amsterdive.com |
Base Domain | amsterdive.com |
Scan Status | Ok |
Last Scan | 2025-06-22T11:06:21+00:00 |
Next Scan | 2025-06-29T11:06:21+00:00 |
Last Scan
Scanned | 2025-06-22T11:06:21+00:00 |
URL | https://amsterdive.com/robots.txt |
Domain IPs | 104.21.28.167, 172.67.146.231, 2606:4700:3030::ac43:92e7, 2606:4700:3037::6815:1ca7 |
Response IP | 104.21.28.167 |
Found | Yes |
Hash | 4c1e5ddd4d10ac7e7b93618dd48a2bd40ca390434457c401b7356522cef1d977 |
SimHash | 43515f82a232 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-login.php |
Disallow | /wp-signup.php |
Disallow | /press-this.php |
Disallow | /remote-login.php |
Disallow | /activate/ |
Disallow | /cgi-bin/ |
Disallow | /mshots/v1/ |
Disallow | /next/ |
Disallow | /public.api/ |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-json/ |
Disallow | /xmlrpc.php |
Disallow | /readme.html |
Disallow | /*? |
Disallow | /?s= |
Allow | /*.css |
Allow | /*.js |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://amsterdive.com/sitemap.xml |
sitemap | https://amsterdive.com/news-sitemap.xml |