Log In Sign Up

aztec5-coursesmc.com
robots.txt

Robots Exclusion Standard data for aztec5-coursesmc.com

Resource Scan

Scan Details

Site Domain aztec5-coursesmc.com
Base Domain aztec5-coursesmc.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-20T15:35:14+00:00
Next Scan 2025-07-27T15:35:14+00:00

Last Successful Scan

Scanned2025-07-17T22:30:51+00:00
URL http://aztec5-coursesmc.com/robots.txt
Redirect https://aztechtraining.com/robots.txt
Redirect Domain aztechtraining.com
Redirect Base aztechtraining.com
Domain IPs 213.175.196.16
Redirect IPs 104.26.12.166, 104.26.13.166, 172.67.75.230, 2606:4700:20::681a:ca6, 2606:4700:20::681a:da6, 2606:4700:20::ac43:4be6
Response IP 104.26.13.166
Found Yes
Hash db82aa1e5d2d15e28b012c1379222adf22f3b139dd8eca0ce4493f61f8a9c1d4
SimHash 8e67cc209cd3

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?s=*
Disallow /search/*
Disallow /?*

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://aztechtraining.com/sitemap_index.xml
Back to top

Comments

  • Global rules
  • -----------------
  • Ban bots that don't benefit us.
  • --------------------------------
Back to top