eltiempo.biz
robots.txt

Robots Exclusion Standard data for eltiempo.biz

Resource Scan

Scan Details

Site Domain eltiempo.biz
Base Domain eltiempo.biz
Scan Status Ok
Last Scan5/27/2025, 7:28:53 PM
Next Scan 6/3/2025, 7:28:53 PM

Last Scan

Scanned5/27/2025, 7:28:53 PM
URL https://eltiempo.biz/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.36.21
Found Yes
Hash 0e5ddb046a57a78a8b124dbce86221af7331caee1603bf02c3d3cd83e8106c2c
SimHash 6d1d5c54e7d7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow

Warnings

  • `request-rate` is not a known field.