Log In Sign Up

prometheusgroup.com
robots.txt

Robots Exclusion Standard data for prometheusgroup.com

Resource Scan

Scan Details

Site Domain prometheusgroup.com
Base Domain prometheusgroup.com
Scan Status Ok
Last Scan2025-09-26T16:46:24+00:00
Next Scan 2025-10-26T16:46:24+00:00

Last Scan

Scanned2025-09-26T16:46:24+00:00
URL https://prometheusgroup.com/robots.txt
Redirect https://www.prometheusgroup.com/robots.txt
Redirect Domain www.prometheusgroup.com
Redirect Base prometheusgroup.com
Domain IPs 199.60.103.124, 199.60.103.24
Redirect IPs 199.60.103.2, 199.60.103.254, 2606:2c40::c73c:6702, 2606:2c40::c73c:67fe
Response IP 199.60.103.2
Found Yes
Hash 91c74b20e361ab943552941b7a028d96a71eb91d0a80943291d8de2b8237be6a
SimHash 68408e11c4b1

Groups

smartling

Rule Path
Allow /
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

*

Rule Path
Disallow /sample-*
Disallow /blog/sample-*
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*
Back to top

Other Records

Field Value
sitemap https://www.prometheusgroup.com/sitemap.xml
Back to top

Comments

  • Allow Smartling crawler full access
  • Rules for all other crawlers
Back to top