Log In Sign Up

hulafrog.com
robots.txt

Robots Exclusion Standard data for hulafrog.com

Resource Scan

Scan Details

Site Domain hulafrog.com
Base Domain hulafrog.com
Scan Status Ok
Last Scan2025-06-15T07:42:43+00:00
Next Scan 2025-07-15T07:42:43+00:00

Last Scan

Scanned2025-06-15T07:42:43+00:00
URL https://hulafrog.com/robots.txt
Redirect https://national.macaronikid.com/robots.txt
Redirect Domain national.macaronikid.com
Redirect Base macaronikid.com
Domain IPs 104.21.39.45, 172.67.143.52, 2606:4700:3033::6815:272d, 2606:4700:3037::ac43:8f34
Redirect IPs 104.26.14.205, 104.26.15.205, 172.67.70.138, 2606:4700:20::681a:ecd, 2606:4700:20::681a:fcd, 2606:4700:20::ac43:468a
Response IP 172.67.70.138
Found Yes
Hash 081a264089aca494821c33399a1e392bde58415538f6f9663bfed6646b358b5e
SimHash d81cdc40fef2

Groups

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /.git
Disallow /.git/*
Disallow /cache
Disallow /cache/*
Disallow /search
Disallow /search/*
Back to top

Comments

  • 1
  • Slow down bots
  • User-agent: *
  • Crawl-delay: 10
  • Backlink Analysis
  • user-agent: AhrefsBot
  • disallow: /
  • http://www.opensiteexplorer.org/dotbot
  • https://megaindex.com/crawler
  • https://www.semrush.com/bot/
Back to top