tatadress.com
robots.txt

Robots Exclusion Standard data for tatadress.com

Resource Scan

Scan Details

Site Domain tatadress.com
Base Domain tatadress.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-09T06:05:27+00:00
Next Scan 2025-12-08T06:05:27+00:00

Last Successful Scan

Scanned2022-09-02T03:42:17+00:00
URL https://tatadress.com/robots.txt
Redirect https://www.tatadress.com/robots.txt
Redirect Domain www.tatadress.com
Redirect Base tatadress.com
Response IP 104.18.128.14
Found Yes
Hash f51bef9cec7eb17d31639079849a4aac9d0673debd31798edd5a3fddd0088e7b
SimHash 6d141f6af392

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /checkout
Disallow /orders
Disallow /search
Disallow /openapi
Disallow /*preview_theme_id*

adsbot-google

Rule Path
Disallow /checkout
Disallow /cart
Disallow /orders
Disallow /*preview_theme_id*

pinterest

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /api/cart*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.tatadress.com/sitemap.xml.gz
sitemap https://www.tatadress.com/sitemap.xml.gz

Comments

  • Google adsbot ignores robots.txt unless specifically named!