textiledetails.com
robots.txt

Robots Exclusion Standard data for textiledetails.com

Resource Scan

Scan Details

Site Domain textiledetails.com
Base Domain textiledetails.com
Scan Status Ok
Last Scan2025-10-08T07:27:51+00:00
Next Scan 2025-10-15T07:27:51+00:00

Last Scan

Scanned2025-10-08T07:27:51+00:00
URL https://textiledetails.com/robots.txt
Domain IPs 145.223.77.81, 2a02:4780:2b:1816:0:ff4:e2ca:2
Response IP 145.223.77.81
Found Yes
Hash 65f7bca2f370283faf9152ee3cbf0ac8bf2e45e52769ff099082b49a3e58f9a6
SimHash 2434c98ae6bb

Groups

*

Rule Path Comment
Disallow /wp-admin/ -
Allow /wp-admin/admin-ajax.php -
Disallow /wp-content/plugins/ -
Disallow /wp-content/themes/ -
Disallow /wp-content/uploads/wc-logs/ -
Disallow /cgi-bin/ -
Disallow /trackback/ -
Disallow /xmlrpc.php -
Disallow /page/ -
Disallow /category/textile/page/ -
Disallow /*?add-to-cart= -
Disallow /?s= -
Disallow /search/ -
Disallow /perform.php -
Disallow /means.php -
Disallow /?IDNO=Nu62644371&cid=12&m=1&g=20 -
Disallow /perform.php?cid=82&pnum=17&m=1&g=20 -
Disallow /?IDNO -
Disallow /_humix_integration_check -
Disallow /comments/ Disallow comments to prevent spam indexing
Disallow /*.php$ Disallow all PHP files (Use with caution!)
Allow /wp-content/uploads/ -

Other Records

Field Value
sitemap https://textiledetails.com/sitemap_index.xml

Comments

  • Disallow directories
  • Disallow specific URL patterns
  • Allow essential files for crawlers