eltiempo.biz
robots.txt
Robots Exclusion Standard data for eltiempo.biz
Resource Scan
Scan Details
Site Domain | eltiempo.biz |
Base Domain | eltiempo.biz |
Scan Status | Ok |
Last Scan | 5/27/2025, 7:28:53 PM |
Next Scan | 6/3/2025, 7:28:53 PM |
Last Scan
Scanned | 5/27/2025, 7:28:53 PM |
URL | https://eltiempo.biz/robots.txt |
Domain IPs | 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21 |
Response IP | 216.239.36.21 |
Found | Yes |
Hash | 0e5ddb046a57a78a8b124dbce86221af7331caee1603bf02c3d3cd83e8106c2c |
SimHash | 6d1d5c54e7d7 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow |
Warnings
- `request-rate` is not a known field.