undernews.fr
robots.txt
Robots Exclusion Standard data for undernews.fr
Resource Scan
Scan Details
| Site Domain | undernews.fr |
| Base Domain | undernews.fr |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-10-05T20:48:13+00:00 |
| Next Scan | 2024-10-12T20:48:13+00:00 |
Last Successful Scan
| Scanned | 2024-09-27T20:47:16+00:00 |
| URL | https://undernews.fr/robots.txt |
| Redirect | https://www.undernews.fr/robots.txt |
| Redirect Domain | www.undernews.fr |
| Redirect Base | undernews.fr |
| Domain IPs | 109.234.164.154 |
| Redirect IPs | 109.234.164.154 |
| Response IP | 109.234.164.154 |
| Found | Yes |
| Hash | fc6a0e69807f7890b8a4ba5397ce418b288db200c257328028618cb827f3c64b |
| SimHash | eb044856aa3a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /xmlrpc.php |
| Disallow | /wp-login.php |
| Disallow | /wp-content/cache/ |
| Disallow | /go/ |
| Disallow | /vpn/ |
| Disallow | /antivirus/ |
| Disallow | /redirect/ |
| Disallow | /*/trackback/ |
| Disallow | /*/feed/ |
| Disallow | /wp-json/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.undernews.fr/sitemap.xml |
| sitemap | https://www.undernews.fr/sitemap.rss |