Log In Sign Up

hangar67.com
robots.txt

Robots Exclusion Standard data for hangar67.com

Resource Scan

Scan Details

Site Domain hangar67.com
Base Domain hangar67.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-08T11:32:03+00:00
Next Scan 2024-10-08T11:32:03+00:00

Last Successful Scan

Scanned2024-07-18T11:29:53+00:00
URL https://hangar67.com/robots.txt
Redirect https://www.hangar67.com/robots.txt
Redirect Domain www.hangar67.com
Redirect Base hangar67.com
Domain IPs 104.26.10.51, 104.26.11.51, 172.67.68.139, 2606:4700:20::681a:a33, 2606:4700:20::681a:b33, 2606:4700:20::ac43:448b
Redirect IPs 104.26.10.51, 104.26.11.51, 172.67.68.139, 2606:4700:20::681a:a33, 2606:4700:20::681a:b33, 2606:4700:20::ac43:448b
Response IP 104.26.11.51
Found Yes
Hash 54980a27cdda242a26ce7892fb60bddcadbb26de7cd85f6c12cd07448d3d96fb
SimHash be7a1d115fe9

Groups

applebot

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

facebot

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /documents/
Disallow /media/
Disallow /custom/
Disallow /jsservices/
Allow /

Other Records

Field Value
crawl-delay 10

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot
bytespider
bytedance

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • Hangar67.com Robots.txt was last updated Nov 20, 2019
  • By using the Site including accessing our Robots.txt you agree to the Hangar 67 Service Terms and Conditions located at https://www.hangar67.com/termsconditions
  • IP addresses and other methods are used to identify viewers. Violation of the Terms and Conditions are taken very seriously.
  • Criminal charges for violating the Computer Fraud and Abuse Act can and have resulted in prison time as well as substantial financial losses for violators.
  • Hangar 67 will pursue all violations of the Service Terms and Conditions to the maximum extent allowed by law.
  • Ban noisy bots
  • --------------------------------
Back to top