broadwayworld.com
robots.txt

Robots Exclusion Standard data for broadwayworld.com

Resource Scan

Scan Details

Site Domain broadwayworld.com
Base Domain broadwayworld.com
Scan Status Ok
Last Scan2024-05-02T18:48:45+00:00
Next Scan 2024-05-09T18:48:45+00:00

Last Scan

Scanned2024-05-02T18:48:45+00:00
URL https://broadwayworld.com/robots.txt
Redirect https://www.broadwayworld.com/robots.txt
Redirect Domain www.broadwayworld.com
Redirect Base broadwayworld.com
Domain IPs 104.26.4.92, 104.26.5.92, 172.67.73.96, 2606:4700:20::681a:45c, 2606:4700:20::681a:55c, 2606:4700:20::ac43:4960
Redirect IPs 104.26.4.92, 104.26.5.92, 172.67.73.96, 2606:4700:20::681a:45c, 2606:4700:20::681a:55c, 2606:4700:20::ac43:4960
Response IP 104.26.4.92
Found Yes
Hash e943296c355a4bbdf6d4d9ee06b230ca6a2291b9981e4fa6a3eeea81c115bd5c
SimHash a204db639ab3

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /getembedcode.cfm
Disallow /board/newcsd.cfm
Disallow /admin2013/
Disallow /grossesshowexcel.cfm
Disallow /wakeupsignup.cfm
Disallow /industry-signup.cfm
Disallow /industry-signup2.cfm
Disallow /articlepixel.php
Disallow /addtheatreinfo.cfm
Disallow /bwidb/nocsd.cfm
Disallow /articleplaydivload2017.cfm
Disallow /bwdbpro.cfm
Disallow /videoembed.php
Disallow /claimtheater.cfm
Disallow /people/xml.php
Disallow /regionaladdmult.cfm
Disallow *regionaladdmult.cfm
Disallow /regionalbuytickets.cfm
Disallow /clear-article-cache.php
Disallow /submitnewsedit.cfm
Disallow /upgraderegionalshow.cfm
Disallow /board/CurrentSearch_Detail.php
Disallow /emailpage.cfm
Disallow /board/emailthread.cfm
Disallow /board/subscribethread.php
Disallow /plugins/feedback.php
Disallow /detroitchicago/
Disallow /porpoiseant/
Disallow /beardeddragon/
Disallow /tardisrocinante/
Disallow /parsonsmaize/
Disallow /edomontonalberta/
Disallow /ezais/
Disallow /cdn-cgi/

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://www.broadwayworld.com/sitemaps.xml