d1ixo36kppfedg.cloudfront.net
robots.txt
Robots Exclusion Standard data for d1ixo36kppfedg.cloudfront.net
Resource Scan
Scan Details
Site Domain | d1ixo36kppfedg.cloudfront.net |
Base Domain | d1ixo36kppfedg.cloudfront.net |
Scan Status | Ok |
Last Scan | 2024-11-14T01:34:14+00:00 |
Next Scan | 2024-12-14T01:34:14+00:00 |
Last Scan
Scanned | 2024-11-14T01:34:14+00:00 |
URL | https://d1ixo36kppfedg.cloudfront.net/robots.txt |
Domain IPs | 13.227.254.49, 13.227.254.52, 13.227.254.54, 13.227.254.88, 2600:9000:200a:2800:9:9edc:e100:93a1, 2600:9000:200a:4000:9:9edc:e100:93a1, 2600:9000:200a:4c00:9:9edc:e100:93a1, 2600:9000:200a:5200:9:9edc:e100:93a1, 2600:9000:200a:5800:9:9edc:e100:93a1, 2600:9000:200a:8c00:9:9edc:e100:93a1, 2600:9000:200a:b000:9:9edc:e100:93a1, 2600:9000:200a:d000:9:9edc:e100:93a1 |
Response IP | 13.227.254.49 |
Found | Yes |
Hash | fabbcb01197d44ff23c300ff000849a4f642130dfbf4f853af84d856895e0bd9 |
SimHash | 20b1d4857730 |
Groups
*
Rule | Path |
---|---|
Disallow | /blog/ |
Disallow | /product/ |
Disallow | /collections/* |
Disallow | /topic/* |
Disallow | /myshop/* |
Disallow | /post/* |
Disallow | /app/* |
Disallow | /reseller/* |
Disallow | /referrals/* |
Disallow | /search/* |
Disallow | /payments/* |
Disallow | */az/* |
Disallow | */fk/* |
Disallow | */sd/* |
Allow | /contact |
Allow | /about |
Allow | /supplier |
Allow | /home |
Allow | /TermsAndConditions |
Allow | /faq |
Allow | /how-it-works |
Allow | /collection |
Allow | /collection/* |
Allow | /cl/* |
Allow | /sl/* |
Allow | /pd/* |
Allow | /shop-assets/* |