apple.com
robots.txt

Robots Exclusion Standard data for apple.com

Resource Scan

Scan Details

Site Domain apple.com
Base Domain apple.com
Scan Status Ok
Last Scan2024-05-07T10:57:54+00:00
Next Scan 2024-05-21T10:57:54+00:00

Last Scan

Scanned2024-05-07T10:57:54+00:00
URL https://apple.com/robots.txt
Redirect https://www.apple.com/robots.txt
Redirect Domain www.apple.com
Redirect Base apple.com
Domain IPs 17.253.144.10, 2620:149:af0::10
Redirect IPs 23.53.216.253, 2600:1413:b000:386::1aca, 2600:1413:b000:387::1aca
Response IP 23.53.216.253
Found Yes
Hash f4a6a3edb4d689f8c963fdd1c23dc2ff028d25cf214968b9ea9654d3e195681e
SimHash 754001464557

Groups

*

Rule Path
Disallow /*/includes/*
Disallow /*shop/bag*
Disallow /*shop/browse/overlay/*
Disallow /*shop/browse/ribbon/*
Disallow /*shop/browse/campaigns/mobile_overlay*
Disallow /*shop/favorites*
Disallow /*shop/iphone/payments/overlay/*
Disallow /*_adc_*/shop/
Disallow /*_aoc_*/shop/
Disallow /*_enterprise*/shop/
Disallow /*_internal-epp-discounted*/shop/
Disallow /*_k12nonbts*/shop/
Disallow /*_kiosk*/shop/
Disallow /*_nonbts*/shop/
Disallow /*_qpromo*/shop/
Disallow /*_refurb-discounted*/shop/
Disallow /cn/*/aow/*
Disallow /go/awards/*
Disallow /newsroom/notifications/*
Disallow /tmall*
Allow /ac/globalnav/2.0/*/images/ac-globalnav/globalnav/search/*

baiduspider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-edu/*
Allow /cn-k12/*

haosouspider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-edu/*
Allow /cn-k12/*

sogou web spider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*

sogou inst spider

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*

sogou spider2

Rule Path
Disallow /*
Allow /cn/*
Allow /cn-k12/*

Other Records

Field Value
sitemap https://www.apple.com/shop/sitemap.xml
sitemap https://www.apple.com/autopush/sitemap/sitemap-index.xml
sitemap https://www.apple.com/newsroom/sitemap.xml
sitemap https://www.apple.com/retail/sitemap/sitemap.xml
sitemap https://www.apple.com/today/sitemap.xml

Comments

  • robots.txt for https://www.apple.com/
  • DaumWebMasterTool:fe46641ef2e4f3f25544ad9d70c6029df24dd184fad54154abaa3c263cf5a09a:h7Tb+WCGBcuKBnKRAHQGEQ==