etfscreen.com
robots.txt
Robots Exclusion Standard data for etfscreen.com
Resource Scan
Scan Details
| Site Domain | etfscreen.com |
| Base Domain | etfscreen.com |
| Scan Status | Ok |
| Last Scan | 2024-10-03T03:18:50+00:00 |
| Next Scan | 2024-10-10T03:18:50+00:00 |
Last Scan
| Scanned | 2024-10-03T03:18:50+00:00 |
| URL | https://www.etfscreen.com/robots.txt |
| Domain IPs | 67.43.5.100 |
| Response IP | 67.43.5.100 |
| Found | Yes |
| Hash | 95a494d5a21fca23424e94ac3678eaccb24ea582bfbf82807c3c39d67d300ab1 |
| SimHash | 4a5fdca0eaba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /c/ |
| Disallow | /blog/wp-admin/ |
| Disallow | /blog/wp-content/plugins/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Comments