bolboljan.net
robots.txt

Robots Exclusion Standard data for bolboljan.net

Resource Scan

Scan Details

Site Domain bolboljan.net
Base Domain bolboljan.net
Scan Status Ok
Last Scan2025-03-16T23:38:17+00:00
Next Scan 2025-04-15T23:38:17+00:00

Last Scan

Scanned2025-03-16T23:38:17+00:00
URL https://bolboljan.net/robots.txt
Redirect https://bolboljan.org/robots.txt
Redirect Domain bolboljan.org
Redirect Base bolboljan.org
Domain IPs 104.21.47.225, 172.67.173.207, 2606:4700:3034::6815:2fe1, 2606:4700:3037::ac43:adcf
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.112.1
Found Yes
Hash e8f798c35c7bb8bc5a664098f6c8aff11272ec4da11e189011dc859544ec67d2
SimHash 2a5e7040cc93

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /sign-in/
Disallow /panel/
Disallow /onlyforapp/

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bolboljan.org/sitemap_index.xml