cartechhome.com
robots.txt

Robots Exclusion Standard data for cartechhome.com

Resource Scan

Scan Details

Site Domain cartechhome.com
Base Domain cartechhome.com
Scan Status Ok
Last Scan2024-09-22T08:34:56+00:00
Next Scan 2024-09-29T08:34:56+00:00

Last Scan

Scanned2024-09-22T08:34:56+00:00
URL https://www.cartechhome.com/robots.txt
Domain IPs 2404:6800:4003:c11::79, 74.125.200.121
Response IP 74.125.68.121
Found Yes
Hash 6a1439492d3b34eb8deb8174c7002ea873b5fb48da130d1da66e8810cd3cbbbb
SimHash 2578024166b3

Groups

mediapartners-google
google-display-ads-bot
*

Rule Path Comment
Disallow /feeds/ -
Disallow /comments/ -
Disallow /p/comments-page.html -
Disallow /search/label/ -
Disallow /private/ Block any sensitive or private areas
Disallow /cgi-bin/ Block CGI scripts directory
Disallow /tmp/ Block temporary files directory

googlebot

Rule Path
Disallow
Disallow /search/label/
Disallow /comments/
Disallow /p/comments-page.html

Other Records

Field Value
sitemap https://www.cartechhome.com/sitemap.xml
sitemap https://www.cartechhome.com/sitemap.xml?orderby=UPDATED

Comments

  • robots.txt for https://www.cartechhome.com/ads.txt
  • Allow all user agents to crawl everything
  • Allow Googlebot to crawl everything
  • Sitemap location