Log In Sign Up

photonics.com
robots.txt

Robots Exclusion Standard data for photonics.com

Resource Scan

Scan Details

Site Domain photonics.com
Base Domain photonics.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-05T09:25:52+00:00
Next Scan 2025-01-03T09:25:52+00:00

Last Successful Scan

Scanned2024-06-01T09:24:04+00:00
URL https://photonics.com/robots.txt
Redirect https://www.photonics.com/robots.txt
Redirect Domain www.photonics.com
Redirect Base photonics.com
Domain IPs 104.26.6.164, 104.26.7.164, 172.67.68.254
Redirect IPs 104.26.6.164, 104.26.7.164, 172.67.68.254
Response IP 104.26.6.164
Found Yes
Hash afea49db376f1157c46af34fbbe56423fb8573d21e5051c0aef4fb41c06021ab
SimHash 05649956df3b

Groups

*

Rule Path
Disallow /404
Disallow /__botCatcher__
Disallow /about
Disallow /Advertisements
Disallow /advertisers
Disallow /ajax
Disallow /BannedIP
Disallow /banlist
Disallow /BGAds
Disallow /bin
Disallow /bmp
Disallow /BMPTest
Disallow /click
Disallow /Click
Disallow /cms
Disallow /Common
Disallow /content
Disallow /Content
Disallow /Controls
Disallow /dictionary
Disallow /Dictionary
Disallow /directory
Disallow /Directory
Disallow /display_article
Disallow /EDU/Handbook
Allow /Marketplace.aspx?Type=HBK
Disallow /email
Disallow /Email
Disallow /employment
Disallow /euro
Disallow /fiber
Disallow /Form
Disallow /form
Disallow /forum
Disallow /ideabox
Disallow /images/index_2.htm
Disallow /industry
Disallow /Industry
Allow /IndustryEvent
Allow /industryEvent
Allow /industryevent
Disallow /intertechpira
Disallow /im%3D
Disallow /LMSILK
Disallow /LinearCharts
Disallow /m/
Disallow /Maintenance
Disallow /Masters
Disallow /Matrix
Disallow /mediakit
Disallow /MediaKit
Disallow /Member
Disallow /member
Disallow /newsletter
Disallow /Newsletter
Allow /newsletter.aspx
Allow /Newsletter.aspx
Allow /newsletters.aspx
Allow /Newsletters.aspx
Disallow /OSICS_DS_Catalogue.pdf
Disallow /photonicsFind
Disallow /portal25
Disallow /readart
Disallow /readprod
Disallow /reg
Disallow /reports
Disallow /reprints
Disallow /Scripts
Disallow /Servings
Disallow /showAd
Disallow /ShowAd
Disallow /ShowObject
Disallow /spectra
Disallow /Spectra
Disallow /Styles
Disallow /Stylesheets
Disallow /submissions
Disallow /Test
Disallow /test
Disallow /todaysheadlines
Disallow /Tools
Disallow /tradeshows
Disallow /unsubscribe
Disallow /Unsubscribe
Disallow /update
Disallow /VPN
Disallow /WebExclusives
Disallow /XML
Disallow /XQ
Disallow /xq

ocelli

Rule Path
Disallow /

googlebot

Rule Path
Disallow /404
Disallow /__botCatcher__
Disallow /about
Disallow /Advertisements
Disallow /advertisers
Disallow /ajax
Disallow /BannedIP
Disallow /banlist
Disallow /BGAds
Disallow /bin
Disallow /bmp
Disallow /BMPTest
Disallow /click
Disallow /Click
Disallow /cms
Disallow /Common
Disallow /content
Disallow /Content
Disallow /Controls
Disallow /dictionary
Disallow /Dictionary
Disallow /directory
Disallow /Directory
Disallow /display_article
Disallow /EDU/Handbook
Allow /Marketplace.aspx?Type=HBK
Disallow /email
Disallow /Email
Disallow /employment
Disallow /euro
Disallow /fiber
Allow /Form
Disallow /forum
Disallow /ideabox
Disallow /images/index_2.htm
Disallow /industry
Disallow /Industry
Allow /IndustryEvent
Allow /industryEvent
Allow /industryevent
Disallow /intertechpira
Disallow /im%3D
Disallow /LMSILK
Disallow /LinearCharts
Disallow /m/
Disallow /Maintenance
Disallow /Masters
Disallow /Matrix
Disallow /mediakit
Disallow /MediaKit
Allow /Member
Allow /member
Disallow /membercenter
Disallow /memberCenter
Disallow /MemberCenter
Disallow /newsletter
Disallow /Newsletter
Allow /newsletter.aspx
Allow /Newsletter.aspx
Allow /newsletters.aspx
Allow /Newsletters.aspx
Disallow /OSICS_DS_Catalogue.pdf
Disallow /photonicsFind
Disallow /portal25
Disallow /readart
Disallow /readprod
Disallow /reg
Disallow /reports
Disallow /reprints
Disallow /Scripts
Disallow /Servings
Disallow /showAd
Disallow /ShowAd
Disallow /ShowObject
Disallow /spectra
Disallow /Spectra
Disallow /Styles
Disallow /Stylesheets
Disallow /submissions
Disallow /Test
Disallow /test
Disallow /todaysheadlines
Disallow /Tools
Disallow /tradeshows
Disallow /unsubscribe
Disallow /Unsubscribe
Disallow /update
Disallow /VPN
Disallow /WebExclusives
Disallow /XML
Disallow /XQ
Disallow /xq
Back to top

Other Records

Field Value
sitemap https://www.photonics.com/SitemapIndex.xml
Back to top

Comments

  • Generic Robot Controls
  • Block the Ocelli bot
  • Googlebot Controls - Most are the same as the generic, but there ARE some differences!
Back to top