asteamtechno.com
robots.txt

Robots Exclusion Standard data for asteamtechno.com

Resource Scan

Scan Details

Site Domain asteamtechno.com
Base Domain asteamtechno.com
Scan Status Ok
Last Scan2025-10-19T16:30:47+00:00
Next Scan 2025-11-18T16:30:47+00:00

Last Scan

Scanned2025-10-19T16:30:47+00:00
URL https://asteamtechno.com/robots.txt
Domain IPs 108.167.146.68
Response IP 108.167.146.68
Found Yes
Hash e4b0d2115a6401a7b234d570e5a6d4ff41d23ddb66e0a32ba1707b87a3d9b25b
SimHash c6a64c10de33

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Disallow /
Disallow /wp-admin/
Disallow
Disallow *?s=*
Disallow /tag/
Disallow /author/
Disallow /cdn-cgi/
Disallow /cgi-bin/
Disallow /?*
Disallow /*/?*
Disallow /*/*/?*
Disallow /?wmc-currency=USD
Disallow /?wmc-currency=INR
Disallow /product-tag/
Disallow /search/*
Disallow /cart/
Disallow /author/
Disallow /orders/
Disallow /checkouts/*
Disallow /checkout/
Disallow /errors/
Disallow /404-error/
Disallow /wishlist*
Disallow /products/page/search/*

Other Records

Field Value
sitemap https://www.asteamtechno.com/sitemap_index.xml

Warnings

  • 1 invalid line.