adata.parts
robots.txt
Robots Exclusion Standard data for adata.parts
Resource Scan
Scan Details
Site Domain | adata.parts |
Base Domain | adata.parts |
Scan Status | Ok |
Last Scan | 2025-03-11T00:45:33+00:00 |
Next Scan | 2025-04-10T00:45:33+00:00 |
Last Scan
Scanned | 2025-03-11T00:45:33+00:00 |
URL | https://adata.parts/robots.txt |
Domain IPs | 104.21.96.123, 172.67.180.16, 2606:4700:3034::ac43:b410, 2606:4700:3037::6815:607b |
Response IP | 104.21.96.123 |
Found | Yes |
Hash | 39de2492b3640d589205d4f3e64cb8f232fdad52705255fdbb2b337b392e4ddd |
SimHash | 490cba744731 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Disallow | /acat/* |
Disallow | /search/number/ |
Disallow | /admintools/ |
Disallow | /security/ |
Disallow | /login/ |
Disallow | /account/ |
Disallow | /history_orders/ |
Disallow | /*?filter |
Disallow | /*?grid=table |
Disallow | /*?limit= |
Disallow | /*?sort=price_asc |
Disallow | /*?grid=list |
Disallow | /*?sort=reset |
Disallow | /*?page= |
Disallow | /*?mark= |
Disallow | /*?close |
Disallow | /*?disallow |
Allow | *.css |
Allow | *.js |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- 1 invalid line.
- `host` is not a known field.