leblogauto.com
robots.txt
Robots Exclusion Standard data for leblogauto.com
Resource Scan
Scan Details
Site Domain | leblogauto.com |
Base Domain | leblogauto.com |
Scan Status | Ok |
Last Scan | 2024-10-31T02:12:14+00:00 |
Next Scan | 2024-11-07T02:12:14+00:00 |
Last Scan
Scanned | 2024-10-31T02:12:14+00:00 |
URL | https://leblogauto.com/robots.txt |
Redirect | https://www.leblogauto.com/robots.txt |
Redirect Domain | www.leblogauto.com |
Redirect Base | leblogauto.com |
Domain IPs | 2001:41d0:202:100:51:254:41:37, 51.254.41.37 |
Redirect IPs | 2001:41d0:202:100:51:254:41:37, 51.254.41.37 |
Response IP | 51.254.41.37 |
Found | Yes |
Hash | cfc2d58cb4604357f453dbe9622cec7c8e5d6da9fd89ab5ed2fdcbb33c76694b |
SimHash | a91d4854ef9b |
Groups
*
Rule | Path |
---|---|
Disallow | /cron/ |
Disallow | /newsletter/ |
Disallow | /ajax/ |
Disallow | /photo/article/ |
Disallow | /photo/theque/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.leblogauto.com/sitemap.xml |