1001tracklist.com
robots.txt
Robots Exclusion Standard data for 1001tracklist.com
Resource Scan
Scan Details
| Site Domain | 1001tracklist.com |
| Base Domain | 1001tracklist.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-14T10:39:14+00:00 |
| Next Scan | 2024-05-28T10:39:14+00:00 |
Last Successful Scan
| Scanned | 2024-04-29T06:00:12+00:00 |
| URL | https://1001tracklist.com/robots.txt |
| Redirect | https://www.1001tracklists.com/robots.txt |
| Redirect Domain | www.1001tracklists.com |
| Redirect Base | 1001tracklists.com |
| Domain IPs | 158.69.5.7 |
| Redirect IPs | 158.69.5.7 |
| Response IP | 158.69.5.7 |
| Found | Yes |
| Hash | e1d08508a8f2cbec29577fa46ce276a863d865e8f70b4f08320985dd91decde7 |
| SimHash | d905c2126612 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/. |
| Disallow | /user/. |
| Disallow | /projects/. |
sitebot
lexxebot
mail.ru
blexbot
ahrefsbot
megaindex
seznambot
cpython
mj12bot
buck
semrushbot
semrushbot-sa
dotbot
adsbot-adsrvr
adsrvrbot
proximic
ias-va/3.1
weborama-fetcher (+http://www.weborama.com))
amazonadbot
petalbot
omgili
sirdatabot
quantcastbot
netseer
| Rule | Path |
|---|---|
| Disallow | / |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |