bolboljan.org
robots.txt

Robots Exclusion Standard data for bolboljan.org

Resource Scan

Scan Details

Site Domain bolboljan.org
Base Domain bolboljan.org
Scan Status Ok
Last Scan2025-03-27T22:55:44+00:00
Next Scan 2025-04-26T22:55:44+00:00

Last Scan

Scanned2025-03-27T22:55:44+00:00
URL https://bolboljan.org/robots.txt
Redirect https://bolboljan.pro/robots.txt
Redirect Domain bolboljan.pro
Redirect Base bolboljan.pro
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.84.217, 172.67.197.96, 2606:4700:3033::ac43:c560, 2606:4700:3035::6815:54d9
Response IP 104.21.84.217
Found Yes
Hash 88d2c2d3077e094bff475f66de4964735746dad29f664493470a8de436bbe41e
SimHash 3a5e6000cc93

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /sign-in/
Disallow /panel/
Disallow /onlyforapp/

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bolboljan.pro/sitemap_index.xml