audiotools.com
robots.txt
Robots Exclusion Standard data for audiotools.com
Resource Scan
Scan Details
Site Domain | audiotools.com |
Base Domain | audiotools.com |
Scan Status | Ok |
Last Scan | 2024-09-29T03:09:49+00:00 |
Next Scan | 2024-10-29T03:09:49+00:00 |
Last Scan
Scanned | 2024-09-29T03:09:49+00:00 |
URL | http://audiotools.com/robots.txt |
Domain IPs | 217.160.0.230 |
Response IP | 217.160.0.230 |
Found | Yes |
Hash | c953deaafdfa1daac7752548aa8b21d98de4fbb4018a9e3aee9a3877a97f3977 |
SimHash | 81d8e3e2dfc7 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /r2r/ |
Disallow | /amp/ |
Disallow | /myndir/ |
Disallow | /dat/ |
Disallow | /cass/ |
Disallow | /companies/ |
Disallow | /ordabok/ |
Disallow | /arm/ |
Disallow | /cart/ |
Disallow | /labels/ |
Disallow | /car/ |
Disallow | /adverts/ |
Disallow | /radios/ |
Disallow | /lp/ |
Disallow | /pers/ |
Disallow | /vamp/ |
Disallow | /informatics/ |
Disallow | /rec/ |
Disallow | /cable/ |
Disallow | /leit/ |
Disallow | /spk/ |
Disallow | /CD/ |
Disallow | /midi/ |
Disallow | /greinar/ |
Disallow | /txt/ |
Disallow | /husgogn/ |
Disallow | /publ/ |
Disallow | /msys/ |
Disallow | /tonlist/ |
Disallow | /old/ |
Disallow | /gtr/ |
Disallow | /leit/ |
Disallow | /mp3/ |
Disallow | /parts/ |
Disallow | /soft/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |