datmay.net
robots.txt
Robots Exclusion Standard data for datmay.net
Resource Scan
Scan Details
| Site Domain | datmay.net |
| Base Domain | datmay.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-04T20:37:21+00:00 |
| Next Scan | 2025-11-03T20:37:21+00:00 |
Last Successful Scan
| Scanned | 2025-08-13T15:29:49+00:00 |
| URL | https://datmay.net/robots.txt |
| Domain IPs | 45.252.248.35 |
| Response IP | 45.252.248.35 |
| Found | Yes |
| Hash | d88ae7946ac9ece5ba1d9703c94ac5bef33af4e011a9c9fbf3f8f6fc68fb4d49 |
| SimHash | 491c99ab6b92 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /media/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-login.php/ |
googlebot
googlebot-image
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /*feed* |
| Disallow | /scripts/ |
| Disallow | /readme.html |
| Disallow | /license.txt |
| Disallow | /search/ |
| Disallow | /wp-admin/ |
| Disallow | /?s= |
| Disallow | /*rss* |
| Disallow | /*feed/rss2/ |
| Disallow | /*?filters* |
| Disallow | /*?filter* |
| Disallow | /*comment-page* |
| Disallow | /*?remove_item* |
| Disallow | /*?add-to-cart* |
| Disallow | /*//* |
| Disallow | /*preview%3Dtrue* |
| Disallow | /*?source=* |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /wp-admin/images/* |
| Allow | /wp-admin/uploads/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://datmay.net/product_cat-sitemap.xml |
| sitemap | https://datmay.net/post-sitemap.xml |