Log In Sign Up

nike.com
robots.txt

Robots Exclusion Standard data for nike.com

Resource Scan

Scan Details

Site Domain nike.com
Base Domain nike.com
Scan Status Ok
Last Scan2024-05-01T12:03:52+00:00
Next Scan 2024-05-15T12:03:52+00:00

Last Scan

Scanned2024-05-01T12:03:52+00:00
URL https://nike.com/robots.txt
Redirect https://www.nike.com/robots.txt
Redirect Domain www.nike.com
Redirect Base nike.com
Domain IPs 108.157.254.113, 108.157.254.64, 108.157.254.80, 108.157.254.92
Redirect IPs 23.73.12.73
Response IP 23.53.216.97
Found Yes
Hash 79f2505c3ea4170f9b17c7c730e811550843878a036a4cf8ecad6cf2d5eaac71
SimHash 14368e2329ad

Groups

*

Rule Path
Disallow */member/inbox
Disallow */member/settings
Disallow */p/
Disallow */checkout/
Disallow /*.swf$
Disallow /*.pdf$
Disallow /pdf/
Disallow /ar/help/
Disallow /br/help/
Disallow /hk/help/
Disallow /uy/help/
Disallow /xf/help/
Disallow /xl/help/
Disallow /xm/help/
Disallow /fragments/recommendations-carousel
Disallow /kr/en$
Disallow /kr/en/

baiduspider

Rule Path
Allow /cn$
Allow /cn/
Allow /CN$
Allow /CN/
Allow /assets/
Allow /static/
Allow /styleguide/
Disallow */w?q=
Disallow */w/?q=
Disallow /

haosouspider

Rule Path
Allow /cn$
Allow /cn/
Allow /CN$
Allow /CN/
Allow /assets/
Allow /static/
Allow /styleguide/
Disallow */w?q=
Disallow */w/?q=
Disallow /

sogou web spider

Rule Path
Allow /cn$
Allow /cn/
Allow /CN$
Allow /CN/
Allow /assets/
Allow /static/
Allow /styleguide/
Disallow */w?q=
Disallow */w/?q=
Disallow /

sogou inst spider

Rule Path
Allow /cn$
Allow /cn/
Allow /CN$
Allow /CN/
Allow /assets/
Allow /static/
Allow /styleguide/
Disallow */w?q=
Disallow */w/?q=
Disallow /

sogou spider2

Rule Path
Allow /cn$
Allow /cn/
Allow /CN$
Allow /CN/
Allow /assets/
Allow /static/
Allow /styleguide/
Disallow */w?q=
Disallow */w/?q=
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nike.com/sitemap-us-help.xml
sitemap https://www.nike.com/sitemap-v2-landingpage-index.xml
sitemap https://www.nike.com/sitemap-v2-pdp-index.xml
sitemap https://www.nike.com/sitemap-v2-snkrsweb-index.xml
sitemap https://www.nike.com/sitemap-v2-gridwall-index.xml
sitemap https://www.nike.com/sitemap-v2-article-index.xml
sitemap https://www.nike.com/sitemap-locator-index.xml
Back to top

Comments

  • www.nike.com robots.txt -- just crawl it.
  • `` ```.`
  • `+/ ``.-/+o+:-.
  • `/mo ``.-:+syhdhs/-`
  • -hMd `..:+oyhmNNmds/-`
  • `oNMM/ ``.-/oyhdmMMMMNdy+:.
  • .hMMMM- `.-/+shdmNMMMMMMNdy+:.
  • :mMMMMM+ `.-:+sydmNMMMMMMMMMNmho:.`
  • :NMMMMMMN: `.-:/oyhmmNMMMMMMMMMMMNmho:.`
  • .NMMMMMMMMNy:` `.-/oshdmNMMMMMMMMMMMMMMMmhs/-`
  • hMMMMMMMMMMMMmhysooosyhdmNMMMMMMMMMMMMMMMMMMmds/-`
  • .MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
  • -MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMNdy+-.`
  • `NMMMMMMMMMMMMMMMMMMMMMMMMMMMMMmyo:.`
  • /NMMMMMMMMMMMMMMMMMMMMMMMmho:.`
  • .yNMMMMMMMMMMMMMMMMmhs/.`
  • ./shdmNNmmdhyo/-``
  • `````
Back to top