Log In Sign Up

crestselect.com
robots.txt

Robots Exclusion Standard data for crestselect.com

Resource Scan

Scan Details

Site Domain crestselect.com
Base Domain crestselect.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-11T02:17:37+00:00
Next Scan 2026-02-18T02:17:37+00:00

Last Successful Scan

Scanned2026-02-09T02:03:02+00:00
URL https://crestselect.com/robots.txt
Domain IPs 2a02:4780:15:f46e:d5:a67:e85:57ee, 2a02:4780:38:be84:cb03:34d8:8cae:852, 77.37.75.136, 93.127.201.57
Response IP 77.37.75.232
Found Yes
Hash 36a52aef27d91ef970aabe6588e58c873f17c3eab034a515cb013ff60c7c592d
SimHash 5aa08a4289f7

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://crestselect.com/sitemap_index.xml
Back to top

Comments

  • This file is automatically added by Rank Math SEO plugin to help a website index better
  • More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP
Back to top