rexsoftware.com
robots.txt

Robots Exclusion Standard data for rexsoftware.com

Resource Scan

Scan Details

Site Domain rexsoftware.com
Base Domain rexsoftware.com
Scan Status Ok
Last Scan2024-05-27T13:55:13+00:00
Next Scan 2024-06-26T13:55:13+00:00

Last Scan

Scanned2024-05-27T13:55:13+00:00
URL https://rexsoftware.com/robots.txt
Redirect https://www.rexsoftware.com/robots.txt
Redirect Domain www.rexsoftware.com
Redirect Base rexsoftware.com
Domain IPs 13.248.155.104, 76.223.27.102
Redirect IPs 3.233.126.24, 34.234.52.18, 52.206.163.162
Response IP 54.178.223.218
Found Yes
Hash 0064754e7bed43adbfe579e9724de677e4384b97c9c955e1aaa562b3a14dff52
SimHash d5d29d658634

Groups

*

Rule Path
Disallow /success/
Disallow /l/
Disallow /internal-tools/
Disallow /careers/
Disallow /c/
Disallow /e/
Disallow /logos/
Disallow /faqs/
Disallow /testimonials/
Disallow /content-call-to-actions/
Disallow /content-seo-blurbs/
Disallow /inside/
Disallow /agency-type/
Disallow /region/
Disallow /faq-tags/
Disallow /tags/
Disallow /s/
Disallow /admin-menu-ad-areas/
Disallow /menu-ad-area/
Disallow /v/
Disallow /nz/success/
Disallow /nz/l/
Disallow /nz/internal-tools/
Disallow /nz/careers/
Disallow /nz/c/
Disallow /nz/e/
Disallow /nz/logos/
Disallow /nz/faqs/
Disallow /nz/testimonials/
Disallow /nz/content-call-to-actions/
Disallow /nz/content-seo-blurbs/
Disallow /nz/inside/
Disallow /nz/agency-type/
Disallow /nz/region/
Disallow /nz/faq-tags/
Disallow /nz/tags/
Disallow /nz/s/
Disallow /nz/admin-menu-ad-areas/
Disallow /nz/menu-ad-area/
Disallow /nz/v/
Disallow /uk/success/
Disallow /uk/l/
Disallow /uk/internal-tools/
Disallow /uk/careers/
Disallow /uk/c/
Disallow /uk/e/
Disallow /uk/logos/
Disallow /uk/faqs/
Disallow /uk/testimonials/
Disallow /uk/content-call-to-actions/
Disallow /uk/content-seo-blurbs/
Disallow /uk/inside/
Disallow /uk/agency-type/
Disallow /uk/region/
Disallow /uk/faq-tags/
Disallow /uk/tags/
Disallow /uk/s/
Disallow /uk/admin-menu-ad-areas/
Disallow /uk/menu-ad-area/
Disallow /uk/v/

semrushbot-sa

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

semrushbot-si

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.rexsoftware.com/sitemap.xml