webautobid.eu
robots.txt
Robots Exclusion Standard data for webautobid.eu
Resource Scan
Scan Details
Site Domain | webautobid.eu |
Base Domain | webautobid.eu |
Scan Status | Ok |
Last Scan | 2024-10-30T01:32:40+00:00 |
Next Scan | 2024-11-29T01:32:40+00:00 |
Last Scan
Scanned | 2024-10-30T01:32:40+00:00 |
URL | https://webautobid.eu/robots.txt |
Domain IPs | 108.156.133.122, 108.156.133.40, 108.156.133.80, 108.156.133.93 |
Response IP | 108.156.133.122 |
Found | Yes |
Hash | 4d5b6cea8f02427376af9e3b75a14b6da8d08af779afcc86d18adf4eda83b7d5 |
SimHash | e945cf534b12 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?* |
Disallow | /*/page-* |
Disallow | /*/details/ |
Disallow | /*/carparts/ |
Disallow | /getimage/ |
Allow | /embed/?* |
Allow | /sitemap.xml?* |