niveales.com
robots.txt
Robots Exclusion Standard data for niveales.com
Resource Scan
Scan Details
Site Domain | niveales.com |
Base Domain | niveales.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-04T18:52:15+00:00 |
Next Scan | 2024-07-04T18:52:15+00:00 |
Last Successful Scan
Scanned | 2024-04-13T18:51:19+00:00 |
URL | https://niveales.com/robots.txt |
Redirect | https://www.niveales.com/robots.txt |
Redirect Domain | www.niveales.com |
Redirect Base | niveales.com |
Domain IPs | 104.21.93.195, 172.67.214.49, 2606:4700:3032::ac43:d631, 2606:4700:3035::6815:5dc3 |
Redirect IPs | 104.21.93.195, 172.67.214.49, 2606:4700:3032::ac43:d631, 2606:4700:3035::6815:5dc3 |
Response IP | 172.67.214.49 |
Found | Yes |
Hash | 16bf3012ab55d4dea4e3af5f28980bc9eafe4ffa9fc76fafe5aebf4bbdf6b6e4 |
SimHash | 6e6b9844afb7 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /widget/ |
Disallow | /xwidget/ |
Disallow | *sort%3D* |
Disallow | *resultat-recherche* |
Disallow | *resultats-recherche* |
Disallow | /app-privacy |
Disallow | /desinscription_newsletter |
Disallow | /maintenance |
Disallow | /test-delay |
Disallow | /index |
Disallow | /mentions-legales |
Disallow | /contact |
Disallow | /compte-app-reset |
Other Records
Field | Value |
---|---|
sitemap | https://www.niveales.com/sitemap.xml |
Comments