broadcom.com
robots.txt

Robots Exclusion Standard data for broadcom.com

Resource Scan

Scan Details

Site Domain broadcom.com
Base Domain broadcom.com
Scan Status Ok
Last Scan2024-09-05T15:58:29+00:00
Next Scan 2024-10-05T15:58:29+00:00

Last Scan

Scanned2024-09-05T15:58:29+00:00
URL https://broadcom.com/robots.txt
Redirect https://www.broadcom.com/robots.txt
Redirect Domain www.broadcom.com
Redirect Base broadcom.com
Domain IPs 50.112.202.115, 52.13.171.212, 54.68.22.26
Redirect IPs 104.18.37.111, 172.64.150.145, 2606:4700:4400::6812:256f, 2606:4700:4400::ac40:9691
Response IP 104.18.37.111
Found Yes
Hash 3ce725d4a5dd8b1816f313910ba58a60b2b5c9e8c9fadee8a0ce1e733807cb8a
SimHash 23051f515740

Groups

screaming frog seo spider/13.2

Rule Path
Allow /
Allow /cs/Satellite?c*
Allow /cs/Satellite?pagename*

*

Rule Path
Allow /cs/Satellite?pagename=AVG2%2FParametric%2FListView
Allow /cs/Satellite?pagename=AVG2%2FParametric%2FGridView
Allow /cs/Satellite?pagename=AVG2%2FBlog%2F
Disallow /cs/Satellite?*
Disallow /cs/Satellite?pagename*
Disallow /images/
Disallow /includes/
Disallow /pages/en/navigation_interface_devices/
Disallow /pages/cn/navigation_interface_devices/
Disallow /pages/jp/navigation_interface_devices/
Disallow /support/oem/
Disallow /docs-and-downloads/sep/
Disallow /docs-and-downloads/noindex/
Disallow /myavago/
Disallow /docs-and-downloads/*
Disallow /company/contact/newsletter-signup
Disallow /company/contact/newsletter-signup/unsubscribe
Disallow /?cid*
Disallow /?PublicationNumber*
Disallow /press/release.php*0
Disallow /*?pname=*
Disallow /support/services-support/ca-services/public-sector-consulting/public-sector-contracts/state-of-texas
Disallow /support/security-center/detected-writeup*
Disallow /avcenter/security/Content/*
Disallow /cdn-cgi/
Disallow /api/wget/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.broadcom.com/xml/sitemap.xml

Comments

  • robots.txt for Broadcom.com 8/24/2021

Warnings

  • 1 invalid line.