cessnaflyer.org
robots.txt

Robots Exclusion Standard data for cessnaflyer.org

Resource Scan

Scan Details

Site Domain cessnaflyer.org
Base Domain cessnaflyer.org
Scan Status Ok
Last Scan2025-09-04T23:47:39+00:00
Next Scan 2025-10-04T23:47:39+00:00

Last Scan

Scanned2025-09-04T23:47:39+00:00
URL https://cessnaflyer.org/robots.txt
Redirect https://www.cessnaflyer.org/robots.txt
Redirect Domain www.cessnaflyer.org
Redirect Base cessnaflyer.org
Domain IPs 104.21.45.197, 172.67.218.128, 2606:4700:3033::6815:2dc5, 2606:4700:3033::ac43:da80
Redirect IPs 104.21.45.197, 172.67.218.128, 2606:4700:3033::6815:2dc5, 2606:4700:3033::ac43:da80
Response IP 104.21.45.197
Found Yes
Hash c08509a216751c2288c4612c8b5527ee9d2aef16eb3ef1f9486b6a2ae26518ef
SimHash 2744d0d0d554

Groups

woobot

Rule Path
Disallow /

semrushbot-bm/1.0

Rule Path
Disallow /

googlebot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

adsbot-google
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

googlebot-image
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

mediapartners-google
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

adsbot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

slurp
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

twitterbot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

bingbot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

msnbot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

yahoo
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

ia_archiver
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

ravencrawler
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

amazonbot
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

facebookexternalhit/1.1

Rule Path
Disallow
Disallow /~*

*

Rule Path
Disallow /bB2ztp_Ypzp0b0uwp_sjabvEpY2T2TqsSpXQsdGMnwM%3D.html

Other Records

Field Value
crawl-delay 5

*

Product Comment
* Disallow everyone else
Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /community/search/browse.html

Comments

  • Allow google, bing, msn, yahoo, amazon
  • Added 20190523 by mpeay
  • Disallow:/index.php?*