Log In Sign Up

thebucknetwork.com
robots.txt

Robots Exclusion Standard data for thebucknetwork.com

Resource Scan

Scan Details

Site Domain thebucknetwork.com
Base Domain thebucknetwork.com
Scan Status Ok
Last Scan2024-11-14T20:18:36+00:00
Next Scan 2024-11-21T20:18:36+00:00

Last Scan

Scanned2024-11-14T20:18:36+00:00
URL https://thebucknetwork.com/robots.txt
Domain IPs 104.21.74.174, 172.67.160.87, 2606:4700:3031::ac43:a057, 2606:4700:3037::6815:4aae
Response IP 172.67.160.87
Found Yes
Hash 78a5a1aa06c1a43aa12ac187ef11bd5575f6b187c2faa6df39c0da9ae767dfa8
SimHash 0c214380c3d3

Groups

*

Rule Path
Disallow /

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
apis-google
feedfetcher-google
google-read-aloud
google-site-verification
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
storebot-google

Rule Path
Allow /

adidxbot
bingpreview
microsoftpreview
microsoft.url.control

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

applebot

Rule Path
Allow /

facebot
twitterbot

Rule Path
Allow /

baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-image
baiduspider-news
baiduspider-mobile
baiduspider-video
duckduckbot
naverbot
seznambot
slurp
yeti
yandex
yandexbot
yandexmobilebot
yandexvideo
yandexwebmaster
yandexsitelinks

Rule Path
Allow /
Back to top

Comments

  • Disallow Unknown Agents
  • Google Bots
  • Microsoft Bots
  • Apple Bots
  • Social Media
  • Other Safe Bots
  • Group 3 Sitemap
  • Sitemap: https://www.thebucknetwork.com/sitemap.xml
  • ________
  • __,_, | |
  • [_|_/ | OK |
  • // |________|
  • _// __ /
  • (_|) |@@|
  • \ \__ \--/ __
  • \o__|----| | __
  • \ }{ /\ )_ / _\
  • /\__/\ \__O (__
  • (--/\--) \__/
  • _)( )(_
  • `---''---`
Back to top