cadbury.co.nz
robots.txt

Robots Exclusion Standard data for cadbury.co.nz

Resource Scan

Scan Details

Site Domain cadbury.co.nz
Base Domain cadbury.co.nz
Scan Status Ok
Last Scan2024-09-26T13:20:33+00:00
Next Scan 2024-10-26T13:20:33+00:00

Last Scan

Scanned2024-09-26T13:20:33+00:00
URL https://cadbury.co.nz/robots.txt
Redirect https://www.cadbury.co.nz/robots.txt
Redirect Domain www.cadbury.co.nz
Redirect Base cadbury.co.nz
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 55e45eaaaf7520f35e3e3e94153355eaace30e040b3fb84ec1b5fa8f3acbb419
SimHash cb85f8a1e392

Groups

*

Rule Path
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /onestepcheckout/
Disallow /catalogsearch/
Disallow /newsletter/
Disallow /sendfriend/
Disallow /customize/
Disallow /index.php/
Disallow /checkout/
Disallow /wishlist/
Disallow /contacts/
Disallow /customer/
Disallow /review/
Disallow /ajax/
Disallow /poll/
Disallow /tag/
Disallow /*.php*
Disallow /*SID%3D*
Disallow /*ajax%3D*
Disallow /*product_list_dir%3D*
Disallow /*product_list_mode%3D*
Disallow /*product_list_order%3D*
Disallow /*product_list_limit%3D*

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cadbury.co.nz/media/nz.xml