aitegroup.com
robots.txt

Robots Exclusion Standard data for aitegroup.com

Resource Scan

Scan Details

Site Domain aitegroup.com
Base Domain aitegroup.com
Scan Status Ok
Last Scan2025-10-28T00:59:39+00:00
Next Scan 2025-11-27T00:59:39+00:00

Last Scan

Scanned2025-10-28T00:59:39+00:00
URL http://aitegroup.com/robots.txt
Redirect http://datos-insights.com/robots.txt
Redirect Domain datos-insights.com
Redirect Base datos-insights.com
Domain IPs 23.185.0.1
Redirect IPs 104.26.14.159, 104.26.15.159, 172.67.75.2, 2606:4700:20::681a:e9f, 2606:4700:20::681a:f9f, 2606:4700:20::ac43:4b02
Response IP 104.26.15.159
Found Yes
Hash d5773bfc2680c7a957e9c3a5111718ef6cd4b74136bfa7d247611449cb02bd22
SimHash bc296880e490

Groups

*

Rule Path
Disallow /login/
Disallow /*option%3Dsaml_user_login*
Disallow /app/datos-insights_datoswebsite_1/*
Disallow /wp-admin/

Other Records

Field Value
sitemap https://datos-insights.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Block only the specific problematic authentication URLs
  • Block WordPress admin (standard practice)
  • XML Sitemap location
  • ---------------------------
  • END YOAST BLOCK