ducksters.com
robots.txt

Robots Exclusion Standard data for ducksters.com

Resource Scan

Scan Details

Site Domain ducksters.com
Base Domain ducksters.com
Scan Status Ok
Last Scan2024-10-05T16:20:24+00:00
Next Scan 2024-10-12T16:20:24+00:00

Last Scan

Scanned2024-10-05T16:20:24+00:00
URL https://ducksters.com/robots.txt
Redirect https://www.ducksters.com/robots.txt
Redirect Domain www.ducksters.com
Redirect Base ducksters.com
Domain IPs 104.26.12.134, 104.26.13.134, 172.67.70.47, 2606:4700:20::681a:c86, 2606:4700:20::681a:d86, 2606:4700:20::ac43:462f
Redirect IPs 104.26.12.134, 104.26.13.134, 172.67.70.47, 2606:4700:20::681a:c86, 2606:4700:20::681a:d86, 2606:4700:20::ac43:462f
Response IP 104.26.12.134
Found Yes
Hash 40f744edeb6cad970aca7c17bb841113ab241cfd4e98281e6538fdda7bd5ab1c
SimHash 144d4b4c462b

Groups

*

Rule Path
Disallow /questions/noindex/
Disallow /questions/10questionquizes/
Disallow /questions/nr/
Disallow /questions/quiz/
Disallow /questions/javascript_quiz/
Disallow /games/data.txt
Disallow /apc/
Disallow /cgi-bin/

yandex

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /