beks-systems.com
robots.txt

Robots Exclusion Standard data for beks-systems.com

Resource Scan

Scan Details

Site Domain beks-systems.com
Base Domain beks-systems.com
Scan Status Ok
Last Scan2025-09-27T23:40:29+00:00
Next Scan 2025-10-11T23:40:29+00:00

Last Scan

Scanned2025-09-27T23:40:29+00:00
URL https://beks-systems.com/robots.txt
Redirect https://www.beks-systems.com/robots.txt
Redirect Domain www.beks-systems.com
Redirect Base beks-systems.com
Domain IPs 104.21.11.6, 172.67.147.77, 2606:4700:3032::6815:b06, 2606:4700:3033::ac43:934d
Redirect IPs 104.21.11.6, 172.67.147.77, 2606:4700:3032::6815:b06, 2606:4700:3033::ac43:934d
Response IP 104.21.11.6
Found Yes
Hash cd088af758e6a2667297934f81b26edf1e06d4f5da5dbeaae97b928285f5b278
SimHash c01cef936dd2

Groups

*

Rule Path
Disallow

jobdiggerspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

olbicobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /l/*/cookie_control/*
Disallow /l/cookie_control/*

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.beks-systems.com/l/sitemaps/index

Comments

  • Allow all

Warnings

  • 2 invalid lines.