Log In Sign Up

intel.in
robots.txt

Robots Exclusion Standard data for intel.in

Resource Scan

Scan Details

Site Domain intel.in
Base Domain intel.in
Scan Status Ok
Last Scan2024-09-25T01:57:45+00:00
Next Scan 2024-10-09T01:57:45+00:00

Last Scan

Scanned2024-09-25T01:57:45+00:00
URL https://intel.in/robots.txt
Redirect https://www.intel.com/robots.txt
Redirect Domain www.intel.com
Redirect Base intel.com
Domain IPs 13.91.95.74
Redirect IPs 23.210.110.123, 2600:1413:b000:383::1ea2, 2600:1413:b000:38b::1ea2
Response IP 23.53.142.217
Found Yes
Hash a850a4084517f6c849d26a2899904d1472c063b95a082f593a7b54ff53d77760
SimHash 530d98d7ee96

Groups

omtrbot/1.0

Rule Path
Allow /content/www/us/en/products/devices-systems/
Allow /content/dam/products/
Allow /libs/apps/intel/services/productseedlist
Disallow /cgi
Disallow /iaweb/
Disallow /cpc/vision/
Disallow /intel/june297/
Disallow /cpc/eps/
Disallow /design/june297/
Disallow /cpc/archive/
Disallow /cpc/dia/
Disallow /cpc/ecs/
Disallow /cpc/fcs/
Disallow /cpc/gif/
Disallow /cpc/OptContent/
Disallow /cpc/pix/
Disallow /cpc/sound/
Disallow /cpc/feature/
Disallow /emergency/
Disallow /content/www/*/*/buy/intelinside/
Disallow /content/www/*/*/buy/inteltechnologyprovider/
Disallow /content/www/*/*/buy/intelproducts/
Disallow /content/www/*/*/homepage/_jcr_content/
Disallow /content/www/*/*/test/
Disallow /content/data/disclaimers/
Disallow /content/www/*/*/contentlibrary.html?
Disallow /content/iip/
Disallow /content/dam/altera-www/global/*/pdfs/assets/
Disallow /content/dam/www/programmable/*/*/pdfs/assets/
Disallow /content/dam/www/public/*/forms/
Disallow /*.swf$
Disallow /*/swf/
Disallow /*/secure/
Disallow /*/wp-expand-server-memory-with-optane*.pdf$
Disallow /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow /content/dam/www/secure/

*

Rule Path
Allow /content/dam/products/catalog/
Allow /content/dam/products/hero/
Disallow /cgi
Disallow /iaweb/
Disallow /cpc/vision/
Disallow /intel/june297/
Disallow /cpc/eps/
Disallow /design/june297/
Disallow /cpc/archive/
Disallow /cpc/dia/
Disallow /cpc/ecs/
Disallow /cpc/fcs/
Disallow /cpc/gif/
Disallow /cpc/OptContent/
Disallow /cpc/pix/
Disallow /cpc/sound/
Disallow /cpc/feature/
Disallow /emergency/
Disallow /content/www/*/*/buy/intelinside/
Disallow /content/www/*/*/buy/inteltechnologyprovider/
Disallow /content/www/*/*/buy/intelproducts/
Disallow /content/www/*/*/homepage/_jcr_content/
Disallow /content/www/*/*/test/
Disallow /content/data/disclaimers/
Disallow /content/www/*/*/contentlibrary.html?
Disallow /content/iip/
Disallow /content/dam/altera-www/global/*/pdfs/assets/
Disallow /content/dam/www/programmable/*/*/pdfs/assets/
Disallow /content/dam/www/public/*/forms/
Disallow /content/dam/products/
Disallow /libs/apps/intel/services/productseedlist
Disallow /now/
Disallow /*countrylabel%3D*%26countrylabel%3D*
Disallow /*%26_escaped_fragment_%3D*
Disallow /*.swf$
Disallow /*/swf/
Disallow /*/secure/
Disallow /*/wp-expand-server-memory-with-optane*.pdf$
Disallow /*/wp-01288-intel-fpgas-accelerate-intel-xeon-scalable*.pdf$
Disallow /content/dam/www/secure/
Disallow /content/www/br/pt/
Disallow /content/www/xl/es/
Disallow /content/www/de/de/
Disallow /content/www/es/es/
Disallow /content/www/fr/fr/
Disallow /content/www/jp/ja/
Disallow /content/www/id/id/
Disallow /content/www/kr/ko/
Disallow /content/www/th/th/
Disallow /content/www/tw/zh/
Disallow /content/www/vn/vi/

seokicks

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

coccocbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

trendictionbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

startmebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

hatenablog-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

cincraw

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

infotigerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

snapchat

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

superfeedr

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yak

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

digitalshadowsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

magus

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

quora-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

inetdex-bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

serendeputybot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

deskyobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

brightedge

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

icc-crawler

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.intel.com/sitemap.xml
Back to top

Comments

  • robots.txt exclusion for www.intel.com/ - US
Back to top