bestbuyactnow.com
robots.txt
Robots Exclusion Standard data for bestbuyactnow.com
Resource Scan
Scan Details
Site Domain | bestbuyactnow.com |
Base Domain | bestbuyactnow.com |
Scan Status | Ok |
Last Scan | 2024-10-25T11:10:06+00:00 |
Next Scan | 2024-11-24T11:10:06+00:00 |
Last Scan
Scanned | 2024-10-25T11:10:06+00:00 |
URL | http://bestbuyactnow.com/robots.txt |
Domain IPs | 52.179.3.249 |
Response IP | 52.179.3.249 |
Found | Yes |
Hash | 489ce20b304253d7ffc08d29277cddd599c9660e91d97f3ea2ec39ff293da485 |
SimHash | c87e55516780 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/* |
Disallow | /default/ajax/* |
Disallow | /resource/* |
Disallow | /style/* |
Disallow | /tracker/* |
Disallow | /widget/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.