diaryofaquilter.com
robots.txt

Robots Exclusion Standard data for diaryofaquilter.com

Resource Scan

Scan Details

Site Domain diaryofaquilter.com
Base Domain diaryofaquilter.com
Scan Status Ok
Last Scan2024-11-15T21:12:57+00:00
Next Scan 2024-11-22T21:12:57+00:00

Last Scan

Scanned2024-11-15T21:12:57+00:00
URL https://diaryofaquilter.com/robots.txt
Domain IPs 104.21.95.162, 172.67.145.238, 2606:4700:3031::ac43:91ee, 2606:4700:3035::6815:5fa2
Response IP 104.21.95.162
Found Yes
Hash ba89258fcc2cdde9c44315afae6fb88738418462a2206d05e57bd5d89105d412
SimHash 8655e382e09b

Groups

qwantify

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

izsearch

Rule Path
Disallow /