q7.sk
robots.txt

Robots Exclusion Standard data for q7.sk

Resource Scan

Scan Details

Site Domain q7.sk
Base Domain q7.sk
Scan Status Ok
Last Scan2024-09-25T06:32:48+00:00
Next Scan 2024-10-25T06:32:48+00:00

Last Scan

Scanned2024-09-25T06:32:48+00:00
URL https://q7.sk/robots.txt
Domain IPs 104.21.62.239, 172.67.168.186, 2606:4700:3030::6815:3eef, 2606:4700:3031::ac43:a8ba
Response IP 172.67.168.186
Found Yes
Hash 8c4e86cb38414a48898ec2e521e86d4c5a709e65bd6c190504a2270703daaf69
SimHash 464d59028203

Groups

yandex
yandexbot

Rule Path
Disallow /

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

googlebot

Rule Path
Allow /

msnbot

Rule Path
Disallow /
Allow /sitemap.xml
Allow /google58b61b0592ae6c4f.html
Allow /index.php

Other Records

Field Value
crawl-delay 10