beritalombok.com
robots.txt

Robots Exclusion Standard data for beritalombok.com

Resource Scan

Scan Details

Site Domain beritalombok.com
Base Domain beritalombok.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-11-17T02:07:35+00:00
Next Scan 2024-12-01T02:07:35+00:00

Last Successful Scan

Scanned2024-11-01T23:05:23+00:00
URL https://beritalombok.com/robots.txt
Redirect https://www.beritalombok.com/robots.txt
Redirect Domain www.beritalombok.com
Redirect Base beritalombok.com
Domain IPs 103.131.51.112
Redirect IPs 103.131.51.112
Response IP 103.131.51.112
Found Yes
Hash 9b30b1994ca9782fa05f934dc8685704f4cb5563932e25ea84cc90721e27b142
SimHash 6150d860c333

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

gptbot

Rule Path
Disallow /