fortinet.com
robots.txt

Robots Exclusion Standard data for fortinet.com

Resource Scan

Scan Details

Site Domain fortinet.com
Base Domain fortinet.com
Scan Status Ok
Last Scan2024-06-04T05:54:22+00:00
Next Scan 2024-06-18T05:54:22+00:00

Last Scan

Scanned2024-06-04T05:54:22+00:00
URL https://fortinet.com/robots.txt
Redirect https://www.fortinet.com/robots.txt
Redirect Domain www.fortinet.com
Redirect Base fortinet.com
Domain IPs 54.151.118.105, 54.177.212.176
Redirect IPs 2406:da18:ad1:1101:bddc:a59:6bd4:5363, 3.1.92.70
Response IP 52.220.222.172
Found Yes
Hash 2d24c3e33485d8895244c4a9247f1107150d55360c223db032b649089409fdb0
SimHash 2c1f35866741

Groups

ccbot/2.0

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended
googleother

Rule Path
Disallow /

baiduspider
bingbot
exabot
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
qwantify

Rule Path
Disallow /form/
Disallow /error.html
Disallow /form.html
Disallow /ir.html
Disallow /content/dam/fortinet/assets/*.txt$
Disallow /partners/mississippi-its.html
Disallow /partners/mississippi-its$
Disallow /partners/california-list-fortinet$
Disallow /partners/alabama-aljp$
Disallow /partners/equalis-group$
Disallow /content/dam/fortinet/assets/partners/state-contracts/*
Disallow /resources-campaign/*
Disallow /br/resources-campaign/*
Disallow /lat/resources-campaign/*
Disallow /gb/resources-campaign/*
Disallow /de/resources-campaign/*
Disallow /fr/resources-campaign/*
Disallow /reports/
Disallow /*.php$
Disallow /*.aspx$
Disallow /*.php?$
Disallow /*.asmx?$
Disallow /content/dam/maindam/*
Disallow /blog/tags-search
Disallow /blog/tags-search.html
Disallow /*?tag=*
Disallow /content/dam/fortinet/assets/solution-guides/ja_jp/LF_fortiproxy.pdf
Disallow /content/dam/fortinet/assets/ja_jp/private/*
Disallow /content/dam/fortinet/assets/private/*
Disallow /content/dam/fortinet/assets/white-papers/vpat*.pdf
Disallow /content/dam/fortinet/assets/white-papers/VPAT*.pdf

mojeekbot
petalbot
youbot
*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fortinet.com/sitemap-index.xml
sitemap https://www.fortinet.com/sitemap.xml
sitemap https://www.fortinet.com/it/sitemap.xml
sitemap https://www.fortinet.com/de/sitemap.xml
sitemap https://www.fortinet.com/fr/sitemap.xml
sitemap https://www.fortinet.com/jp/sitemap.xml
sitemap https://www.fortinet.com/kr/sitemap.xml
sitemap https://www.fortinet.com/cn/sitemap.xml
sitemap https://www.fortinet.com/tw/sitemap.xml
sitemap https://www.fortinet.com/br/sitemap.xml
sitemap https://www.fortinet.com/lat/sitemap.xml
sitemap https://www.fortinet.com/uk/sitemap.xml
sitemap https://www.fortinet.com/bin/fortinet/allnewsxml