techliquidators.com
robots.txt

Robots Exclusion Standard data for techliquidators.com

Resource Scan

Scan Details

Site Domain techliquidators.com
Base Domain techliquidators.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-04T11:05:53+00:00
Next Scan 2024-08-02T11:05:53+00:00

Last Successful Scan

Scanned2023-07-03T10:59:27+00:00
URL https://techliquidators.com/robots.txt
Redirect https://www.techliquidators.com/robots.txt
Redirect Domain www.techliquidators.com
Redirect Base techliquidators.com
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash 36c0925d14257ab8126afdf1a6f915561cdef22792387a7a1274369752f72e19
SimHash a2991dcddf65

Groups

*

Rule Path
Disallow /account/
Disallow /checkout/
Disallow /cart/
Disallow /orders/
Disallow /lots/search/
Disallow /listing_manifests/

Other Records

Field Value
sitemap https://<%=Settings.host=>/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • tell the bots where to find our sitemap