alcoholrehabguide.org
robots.txt

Robots Exclusion Standard data for alcoholrehabguide.org

Resource Scan

Scan Details

Site Domain alcoholrehabguide.org
Base Domain alcoholrehabguide.org
Scan Status Ok
Last Scan2024-05-22T20:44:14+00:00
Next Scan 2024-06-21T20:44:14+00:00

Last Scan

Scanned2024-05-22T20:44:14+00:00
URL https://alcoholrehabguide.org/robots.txt
Domain IPs 104.26.4.208, 104.26.5.208, 172.67.69.49, 2606:4700:20::681a:4d0, 2606:4700:20::681a:5d0, 2606:4700:20::ac43:4531
Response IP 172.67.69.49
Found Yes
Hash debbda433e8b12baf818211eb9718ef48cea8c26e81c9b0070193dea2ef0dc4a
SimHash 640090d1e517

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php
Disallow /?s=*
Disallow /search/*

Other Records

Field Value
sitemap https://www.alcoholrehabguide.org/sitemap_index.xml

Comments

  • Global rules
  • -----------------
  • Prevent search result spam
  • Point to sitemap for crawling