d-list.net
robots.txt
Robots Exclusion Standard data for d-list.net
Resource Scan
Scan Details
Site Domain | d-list.net |
Base Domain | d-list.net |
Scan Status | Ok |
Last Scan | 2025-03-08T19:44:16+00:00 |
Next Scan | 2025-03-15T19:44:16+00:00 |
Last Scan
Scanned | 2025-03-08T19:44:16+00:00 |
URL | https://d-list.net/robots.txt |
Domain IPs | 104.21.87.45, 172.67.141.126, 2606:4700:3030::ac43:8d7e, 2606:4700:3033::6815:572d |
Response IP | 172.67.141.126 |
Found | Yes |
Hash | aedcb9eefa4097b9ca5d054050ae2625b9baea081be2aa5f06e1e512f37802d0 |
SimHash | e9a1a800ecbb |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-content/uploads/wc-logs/ |
Disallow | /wp-content/uploads/woocommerce_transient_files/ |
Disallow | /wp-content/uploads/woocommerce_uploads/ |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://d-list.net/sitemap_index.xml |
Comments