gotchew.co
robots.txt

Robots Exclusion Standard data for gotchew.co

Resource Scan

Scan Details

Site Domain gotchew.co
Base Domain gotchew.co
Scan Status Ok
Last Scan2025-10-06T02:37:11+00:00
Next Scan 2025-10-20T02:37:11+00:00

Last Scan

Scanned2025-10-06T02:37:11+00:00
URL https://gotchew.co/robots.txt
Redirect https://www.gotchew.co/robots.txt
Redirect Domain www.gotchew.co
Redirect Base gotchew.co
Domain IPs 172.66.40.181, 172.66.43.75, 2606:4700:3108::ac42:28b5, 2606:4700:3108::ac42:2b4b
Redirect IPs 172.66.40.181, 172.66.43.75, 2606:4700:3108::ac42:28b5, 2606:4700:3108::ac42:2b4b
Response IP 172.66.43.75
Found Yes
Hash e397b8f948a716adeb36032025145f6d5011d626fe41ed82fd0e07024d676ef5
SimHash 4a3c983390d0

Groups

*

Rule Path
Allow /assets/*
Allow /templates/*
Allow /*.css
Allow /*.ttf
Allow /*.woff2
Allow /*.woff
Allow /*.png
Allow /*.jpg
Allow /*.webp
Allow /*v%3D4.7.0
Allow /*category*
Allow /*product*
Allow /%7B
Allow /%7B%7BngMeta.canonical%7D%7D
Disallow /*%*
Disallow /%*
Disallow /templates/web/views/share-popover.html
Disallow /?mc
Disallow /%2C
Disallow /zaraz
Disallow /cdn-cgi/zaraz/*
Disallow /ads.txt
Disallow /business/
Disallow /orders
Disallow /settings/
Disallow /listing
Disallow /checkout
Disallow /confirm-order
Disallow /pages/*

googlebot

Rule Path
Allow /search/*
Allow /*category*
Allow /*product*
Allow /assets/*
Allow /templates/*
Allow /*.css
Allow /*.ttf
Allow /*.woff2
Allow /*.woff
Allow /*.png
Allow /*.jpg
Allow /*.webp
Allow /*v%3D4.7.0
Allow /%7B
Allow /%7B%7BngMeta.canonical%7D%7D
Disallow /*%*
Disallow /zaraz
Disallow /cdn-cgi/zaraz/*
Disallow /ads.txt

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gotchew.co/sitemap.xml

Comments

  • Disallow: /*?*
  • Disallow: /*=*