auto.bigmir.net
robots.txt
Robots Exclusion Standard data for auto.bigmir.net
Resource Scan
Scan Details
Site Domain | auto.bigmir.net |
Base Domain | bigmir.net |
Scan Status | Ok |
Last Scan | 2024-05-26T10:41:30+00:00 |
Next Scan | 2024-06-25T10:41:30+00:00 |
Last Scan
Scanned | 2024-05-26T10:41:30+00:00 |
URL | https://auto.bigmir.net/robots.txt |
Domain IPs | 65.8.161.103, 65.8.161.112, 65.8.161.119, 65.8.161.20 |
Response IP | 108.157.52.126 |
Found | Yes |
Hash | 1389b27cdbf9096df4e60fd4234d626c4e5a1034e2a6afcd88aeaa3ddc90e7ed |
SimHash | 0c059822e511 |
Groups
*
Rule | Path |
---|---|
Disallow | *tplmode%3Dprint |
Disallow | *tpl%3Dr_news_popular |
Disallow | */signin |
Disallow | */login |
Disallow | */share |
Disallow | */search |
Disallow | /click |
Other Records
Field | Value |
---|---|
sitemap | https://auto.bigmir.net/sitemap.xml |
sitemap | https://auto.bigmir.net/sitemap.news.xml |
Warnings
- `host` is not a known field.