Log In Sign Up

x-cart.com
robots.txt

Robots Exclusion Standard data for x-cart.com

Resource Scan

Scan Details

Site Domain x-cart.com
Base Domain x-cart.com
Scan Status Ok
Last Scan2025-12-16T11:56:17+00:00
Next Scan 2026-01-15T11:56:17+00:00

Last Scan

Scanned2025-12-16T11:56:17+00:00
URL https://x-cart.com/robots.txt
Redirect https://www.x-cart.com/robots.txt
Redirect Domain www.x-cart.com
Redirect Base x-cart.com
Domain IPs 172.66.135.30, 172.66.138.56, 2606:4700:10::ac42:871e, 2606:4700:10::ac42:8a38
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 146.75.46.132
Found Yes
Hash 27fa01ecb8149a2c641c81f8a2aa4f5de0fda55026b3f51d8970bcf3949788d4
SimHash 47e20e770eb2

Groups

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /template.html
Disallow /wp-admin
Disallow /wp-includes
Allow /wp-includes/wlwmanifest.xml
Allow /wp-includes/js/mediaelement/mediaelement-flash-video.swf
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow /?feed=
Disallow /software/*.zip
Disallow /software/*.tgz
Disallow /download/*.pdf
Disallow /software/*.pdf
Allow /download/aov_pa-dss_form-cdev.pdf
Disallow /showthread.php*
Disallow /header.html
Disallow /xcart_manual/*.pptx
Disallow /xcart_manual/*.zip
Disallow /xcart_manual/*.tgz
Disallow /xcart_manual/*.chm
Disallow /xcart_manual/CVS/
Disallow /xcart_manual/*/CVS/
Allow /wp-content/uploads/
Allow /*/*/*.css*
Allow /*/*/*/*.css*
Allow /*/*/*/*/*.css*
Allow /*/*/*.js*
Allow /*/*/*/*.js*
Allow /*/*/*/*/*.js*
Allow /wp-includes/js/*.js
Allow /wp-includes/js/*.svg
Back to top

Other Records

Field Value
sitemap https://www.x-cart.com/sitemap_index.xml
Back to top

Comments

  • Disallow: /xmlrpc.php
  • Disallow: /?s=
  • Disallow: /sites/default/files/modules/files/*.pdf
  • Disallow: /sites/default/files/*.pdf
  • Disable indexing for affiliate pages
  • Disallow: /aff/
  • Disable indexing XC distributives
  • Redirects to the forum
  • Disallow: /xml/xp.modules.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top