soumae.org
robots.txt
Robots Exclusion Standard data for soumae.org
Resource Scan
Scan Details
| Site Domain | soumae.org |
| Base Domain | soumae.org |
| Scan Status | Ok |
| Last Scan | 2024-11-10T17:27:49+00:00 |
| Next Scan | 2024-11-17T17:27:49+00:00 |
Last Scan
| Scanned | 2024-11-10T17:27:49+00:00 |
| URL | https://soumae.org/robots.txt |
| Domain IPs | 104.21.73.254, 172.67.167.139, 2606:4700:3033::ac43:a78b, 2606:4700:3036::6815:49fe |
| Response IP | 104.21.73.254 |
| Found | Yes |
| Hash | dc50234a076a204bed7c1e3385edab23bb72db5937d1f9515b43e747012c33cb |
| SimHash | fd205a44dbf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | */xmlrpc.php |
| Disallow | */wp-*.php |
| Disallow | */trackback/ |
| Disallow | *?wptheme= |
| Disallow | *?comments= |
| Disallow | *?replytocom |
| Disallow | */comment-page- |
| Disallow | *?s= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.soumae.org/sitemap_index.xml |