regolith.pro
robots.txt

Robots Exclusion Standard data for regolith.pro

Resource Scan

Scan Details

Site Domain regolith.pro
Base Domain regolith.pro
Scan Status Ok
Last Scan5/15/2025, 12:17:54 PM
Next Scan 5/29/2025, 12:17:54 PM

Last Scan

Scanned5/15/2025, 12:17:54 PM
URL https://regolith.pro/robots.txt
Redirect https://regolith.com/robots.txt
Redirect Domain regolith.com
Redirect Base regolith.com
Domain IPs 104.21.64.234, 172.67.137.179, 2606:4700:3030::6815:40ea, 2606:4700:3031::ac43:89b3
Redirect IPs 104.21.87.254, 172.67.149.71, 2606:4700:3034::6815:57fe, 2606:4700:3037::ac43:9547
Response IP 104.21.87.254
Found Yes
Hash 3be41694c4a4e53e82fe6eb878b188adce42b210d59872df1e877601a589f7b4
SimHash 49004e422790

Groups

*

Rule Path
Disallow /*?*
Disallow /*?
Disallow /admin/
Disallow /config/
Disallow /system/
Disallow /upload/
Disallow /vendor/
Disallow /delete/

yandex

Rule Path
Disallow /*?*
Disallow /*?
Disallow /admin/
Disallow /config/
Disallow /system/
Disallow /upload/
Disallow /vendor/
Disallow /delete/

googlebot

Rule Path
Disallow /*?*
Disallow /*?
Disallow /admin/
Disallow /config/
Disallow /system/
Disallow /upload/
Disallow /vendor/
Disallow /delete/

Other Records

Field Value
sitemap https://regolith.com/sitemap.xml
sitemap https://regolith.com/sitemap.xml
sitemap https://regolith.com/sitemap.xml

Warnings

  • `host` is not a known field.