cdm.me
robots.txt
Robots Exclusion Standard data for cdm.me
Resource Scan
Scan Details
Site Domain | cdm.me |
Base Domain | cdm.me |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-16T10:43:58+00:00 |
Next Scan | 2024-12-15T10:43:58+00:00 |
Last Successful Scan
Scanned | 2024-05-20T10:42:51+00:00 |
URL | https://cdm.me/robots.txt |
Redirect | https://www.cdm.me/robots.txt |
Redirect Domain | www.cdm.me |
Redirect Base | cdm.me |
Domain IPs | 104.26.6.222, 104.26.7.222, 172.67.68.184, 2606:4700:20::681a:6de, 2606:4700:20::681a:7de, 2606:4700:20::ac43:44b8 |
Redirect IPs | 104.26.6.222, 104.26.7.222, 172.67.68.184, 2606:4700:20::681a:6de, 2606:4700:20::681a:7de, 2606:4700:20::ac43:44b8 |
Response IP | 104.26.7.222 |
Found | Yes |
Hash | cd2fde2dbdcffd0f05fbbcb7ec1fadbf2c7ee369443372c037346a1f46fb71b1 |
SimHash | 6d28dc628ba2 |
Groups
*
Rule | Path |
---|---|
Disallow | /?cdmblackhole |
Disallow | /?essb_counter_cache=rebuild |
Disallow | /wp-json/wordpress-popular-posts/v1/popular-posts |
Disallow | /wp-admin/ |
Disallow | /feed/ |
Disallow | /xmlrpc.php |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |