broadcom.com
robots.txt
Robots Exclusion Standard data for broadcom.com
Resource Scan
Scan Details
Site Domain | broadcom.com |
Base Domain | broadcom.com |
Scan Status | Ok |
Last Scan | 2024-09-05T15:58:29+00:00 |
Next Scan | 2024-10-05T15:58:29+00:00 |
Last Scan
Scanned | 2024-09-05T15:58:29+00:00 |
URL | https://broadcom.com/robots.txt |
Redirect | https://www.broadcom.com/robots.txt |
Redirect Domain | www.broadcom.com |
Redirect Base | broadcom.com |
Domain IPs | 50.112.202.115, 52.13.171.212, 54.68.22.26 |
Redirect IPs | 104.18.37.111, 172.64.150.145, 2606:4700:4400::6812:256f, 2606:4700:4400::ac40:9691 |
Response IP | 104.18.37.111 |
Found | Yes |
Hash | 3ce725d4a5dd8b1816f313910ba58a60b2b5c9e8c9fadee8a0ce1e733807cb8a |
SimHash | 23051f515740 |
Groups
screaming frog seo spider/13.2
Rule | Path |
---|---|
Allow | / |
Allow | /cs/Satellite?c* |
Allow | /cs/Satellite?pagename* |
*
Rule | Path |
---|---|
Allow | /cs/Satellite?pagename=AVG2%2FParametric%2FListView |
Allow | /cs/Satellite?pagename=AVG2%2FParametric%2FGridView |
Allow | /cs/Satellite?pagename=AVG2%2FBlog%2F |
Disallow | /cs/Satellite?* |
Disallow | /cs/Satellite?pagename* |
Disallow | /images/ |
Disallow | /includes/ |
Disallow | /pages/en/navigation_interface_devices/ |
Disallow | /pages/cn/navigation_interface_devices/ |
Disallow | /pages/jp/navigation_interface_devices/ |
Disallow | /support/oem/ |
Disallow | /docs-and-downloads/sep/ |
Disallow | /docs-and-downloads/noindex/ |
Disallow | /myavago/ |
Disallow | /docs-and-downloads/* |
Disallow | /company/contact/newsletter-signup |
Disallow | /company/contact/newsletter-signup/unsubscribe |
Disallow | /?cid* |
Disallow | /?PublicationNumber* |
Disallow | /press/release.php*0 |
Disallow | /*?pname=* |
Disallow | /support/services-support/ca-services/public-sector-consulting/public-sector-contracts/state-of-texas |
Disallow | /support/security-center/detected-writeup* |
Disallow | /avcenter/security/Content/* |
Disallow | /cdn-cgi/ |
Disallow | /api/wget/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.broadcom.com/xml/sitemap.xml |
Warnings
- 1 invalid line.
Comments