shouldianswer.com
robots.txt

Robots Exclusion Standard data for shouldianswer.com

Resource Scan

Scan Details

Site Domain shouldianswer.com
Base Domain shouldianswer.com
Scan Status Ok
Last Scan2025-11-26T00:44:00+00:00
Next Scan 2025-12-03T00:44:00+00:00

Last Scan

Scanned2025-11-26T00:44:00+00:00
URL https://shouldianswer.com/robots.txt
Redirect https://www.shouldianswer.com/robots.txt
Redirect Domain www.shouldianswer.com
Redirect Base shouldianswer.com
Domain IPs 104.21.23.224, 172.67.213.249, 2606:4700:3036::ac43:d5f9, 2606:4700:3037::6815:17e0
Redirect IPs 104.21.23.224, 172.67.213.249, 2606:4700:3036::ac43:d5f9, 2606:4700:3037::6815:17e0
Response IP 172.67.213.249
Found Yes
Hash 340b42cb5a8762363b7c23653fc6e888718e71d6bc93acbf8b3f464796b19b28
SimHash 505d44627172

Groups

spbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

daum

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

clickagy

Rule Path
Disallow /

admantx

Rule Path
Disallow /

deusu

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /