Log In Sign Up

certificates.intel.com
robots.txt

Robots Exclusion Standard data for certificates.intel.com

Resource Scan

Scan Details

Site Domain certificates.intel.com
Base Domain intel.com
Scan Status Ok
Last Scan2024-04-29T13:23:37+00:00
Next Scan 2024-05-29T13:23:37+00:00

Last Scan

Scanned2024-04-29T13:23:37+00:00
URL http://certificates.intel.com/robots.txt
Domain IPs 23.202.34.137, 23.202.34.153
Response IP 104.91.68.8
Found Yes
Hash b00dcab7e63d1151fcea1fbcf6e8ea2158b957d46b73f7f0d88b17ea32e5bdd6
SimHash 530d18d7ce9e

Groups

omtrbot/1.0

Rule Path
Allow /content/www/us/en/products/devices-systems/
Allow /content/dam/products/
Allow /libs/apps/intel/services/productseedlist
Disallow /cgi
Disallow /iaweb/
Disallow /cpc/vision/
Disallow /intel/june297/
Disallow /cpc/eps/
Disallow /design/june297/
Disallow /cpc/archive/
Disallow /cpc/dia/
Disallow /cpc/ecs/
Disallow /cpc/fcs/
Disallow /cpc/gif/
Disallow /cpc/OptContent/
Disallow /cpc/pix/
Disallow /cpc/sound/
Disallow /cpc/feature/
Disallow /emergency/
Disallow /content/www/*/*/buy/intelinside/
Disallow /content/www/*/*/buy/inteltechnologyprovider/
Disallow /content/www/*/*/buy/intelproducts/
Disallow /content/www/*/*/homepage/_jcr_content/
Disallow /content/www/*/*/test/
Disallow /content/data/disclaimers/
Disallow /content/www/*/*/contentlibrary.html?
Disallow /content/iip/
Disallow /content/dam/altera-www/global/*/pdfs/assets/
Disallow /content/dam/www/programmable/*/*/pdfs/assets/
Disallow /content/dam/www/public/*/forms/
Disallow /*.swf$
Disallow /*/swf/
Disallow /*/secure/
Disallow /*/wp-expand-server-memory-with-optane*.pdf$
Disallow /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow /content/dam/www/secure/

*

Rule Path
Allow /content/dam/products/catalog/
Allow /content/dam/products/hero/
Disallow /cgi
Disallow /iaweb/
Disallow /cpc/vision/
Disallow /intel/june297/
Disallow /cpc/eps/
Disallow /design/june297/
Disallow /cpc/archive/
Disallow /cpc/dia/
Disallow /cpc/ecs/
Disallow /cpc/fcs/
Disallow /cpc/gif/
Disallow /cpc/OptContent/
Disallow /cpc/pix/
Disallow /cpc/sound/
Disallow /cpc/feature/
Disallow /emergency/
Disallow /content/www/*/*/buy/intelinside/
Disallow /content/www/*/*/buy/inteltechnologyprovider/
Disallow /content/www/*/*/buy/intelproducts/
Disallow /content/www/*/*/homepage/_jcr_content/
Disallow /content/www/*/*/test/
Disallow /content/data/disclaimers/
Disallow /content/www/*/*/contentlibrary.html?
Disallow /content/iip/
Disallow /content/dam/altera-www/global/*/pdfs/assets/
Disallow /content/dam/www/programmable/*/*/pdfs/assets/
Disallow /content/dam/www/public/*/forms/
Disallow /content/dam/products/
Disallow /libs/apps/intel/services/productseedlist
Disallow /now/
Disallow /*countrylabel%3D*%26countrylabel%3D*
Disallow /*%26_escaped_fragment_%3D*
Disallow /*.swf$
Disallow /*/swf/
Disallow /*/secure/
Disallow /*/wp-expand-server-memory-with-optane*.pdf$
Disallow /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow /content/dam/www/secure/
Disallow /content/www/br/pt/
Disallow /content/www/xl/es/
Disallow /content/www/de/de/
Disallow /content/www/es/es/
Disallow /content/www/fr/fr/
Disallow /content/www/jp/ja/
Disallow /content/www/id/id/
Disallow /content/www/kr/ko/
Disallow /content/www/th/th/
Disallow /content/www/tw/zh/
Disallow /content/www/vn/vi/

seokicks

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

coccocbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

trendictionbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

startmebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

hatenablog-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

cincraw

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

infotigerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

snapchat

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

superfeedr

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

yak

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

digitalshadowsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

magus

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

quora-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

inetdex-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

serendeputybot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

deskyobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

brightedge

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4

icc-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.intel.com/sitemap.xml
Back to top

Comments

  • robots.txt exclusion for www.intel.com/ - US
Back to top