cyberprotex.com
robots.txt

Robots Exclusion Standard data for cyberprotex.com

Resource Scan

Scan Details

Site Domain cyberprotex.com
Base Domain cyberprotex.com
Scan Status Ok
Last Scan2025-11-29T08:49:30+00:00
Next Scan 2025-12-06T08:49:30+00:00

Last Scan

Scanned2025-11-29T08:49:30+00:00
URL https://cyberprotex.com/robots.txt
Redirect https://www.cyberprotex.com/robots.txt
Redirect Domain www.cyberprotex.com
Redirect Base cyberprotex.com
Domain IPs 199.34.228.69
Redirect IPs 199.34.228.69
Response IP 199.34.228.69
Found Yes
Hash c2b888b487ef3bfa6f5c6932aeaf8f7d13ceead20b9f62c10047f03ab9f78bd8
SimHash 8164dc360693

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /cybershield2021-curriculum.html
Disallow /cyberninja-social-engineering.html
Disallow /vulngeniustm-rates.html
Disallow /forensics.html
Disallow /termsandconditions.html

Other Records

Field Value
sitemap https://www.cyberprotex.com/sitemap.xml