slowatch.si
robots.txt

Robots Exclusion Standard data for slowatch.si

Resource Scan

Scan Details

Site Domain slowatch.si
Base Domain slowatch.si
Scan Status Ok
Last Scan2024-10-23T20:08:11+00:00
Next Scan 2024-11-22T20:08:11+00:00

Last Scan

Scanned2024-10-23T20:08:11+00:00
URL https://slowatch.si/robots.txt
Redirect https://www.slowatch.si/robots.txt
Redirect Domain www.slowatch.si
Redirect Base slowatch.si
Domain IPs 89.58.4.242
Redirect IPs 89.58.4.242
Response IP 89.58.4.242
Found Yes
Hash 65bd8cfcbcfd25b70fb13d9589919fd24b1fb962d6c7de21eeae41a2debfaec3
SimHash 48525850ca52

Groups

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 30 Sets a delay of 10 seconds between requests for SEMrushBot

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 30 Sets a delay of 20 seconds between requests for AhrefsBot

bytespider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10