padini.com
robots.txt

Robots Exclusion Standard data for padini.com

Resource Scan

Scan Details

Site Domain padini.com
Base Domain padini.com
Scan Status Ok
Last Scan2025-11-25T21:13:28+00:00
Next Scan 2025-12-09T21:13:28+00:00

Last Scan

Scanned2025-11-25T21:13:28+00:00
URL https://padini.com/robots.txt
Redirect https://www.padini.com/robots.txt
Redirect Domain www.padini.com
Redirect Base padini.com
Domain IPs 108.156.144.124, 108.156.144.73, 108.156.144.79, 108.156.144.80
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.113.124
Found Yes
Hash 3fdfc515957e4135fd494dddf3e71c6cd6fb0a90c55c784175ad863cd7c405c2
SimHash 6414d97261ca

Groups

*

Rule Path
Disallow /index.php/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /wishlist/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /enable-cookies/
Disallow /LICENSE.txt
Disallow /LICENSE.html
Disallow /skin/
Disallow /js/
Disallow /directory/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?*color=
Disallow /*?*cat=
Disallow /*?*sale_label=
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pub/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

nostocrawlerbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

crawldaddy

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.padini.com/media/sitemap/sitemap.xml

Comments

  • Disallow: /*?
  • Stop crawling user account and checkout pages by search engine robot:
  • Blocking native catalog and search pages:
  • Sometimes Webmasters block pages with filters..
  • Blocking CMS directories.
  • User-agent: Googlebot-image
  • Disallow: /
  • SEO & Scraper Bots
  • Generic “bad behavior” or bandwidth-heavy crawlers

Warnings

  • 1 invalid line.