junip.net
robots.txt

Robots Exclusion Standard data for junip.net

Resource Scan

Scan Details

Site Domain junip.net
Base Domain junip.net
Scan Status Ok
Last Scan2025-03-20T14:29:12+00:00
Next Scan 2025-04-19T14:29:12+00:00

Last Scan

Scanned2025-03-20T14:29:12+00:00
URL https://junip.net/robots.txt
Domain IPs 104.21.40.210, 172.67.157.12, 2606:4700:3031::6815:28d2, 2606:4700:3033::ac43:9d0c
Response IP 172.67.157.12
Found Yes
Hash 9b93b7e4ef2497c1418ffbdd8d0e508fad267f5810dfdce0c0ec58502956ffb9
SimHash 224654d28117

Groups

*

Rule Path
Allow /
Disallow /inc/
Disallow /js/
Disallow /css/
Disallow /tools/

Other Records

Field Value
crawl-delay 10

googlebot/2.1

Rule Path
Allow /

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

wormly

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

Comments

  • E-mail webmaster@section101.com if you're authorized to access this site, but getting denied.