Log In Sign Up

cirandas.net
robots.txt

Robots Exclusion Standard data for cirandas.net

Resource Scan

Scan Details

Site Domain cirandas.net
Base Domain cirandas.net
Scan Status Ok
Last Scan2024-09-15T03:23:35+00:00
Next Scan 2024-10-15T03:23:35+00:00

Last Scan

Scanned2024-09-15T03:23:35+00:00
URL https://cirandas.net/robots.txt
Domain IPs 104.21.54.28, 172.67.222.229, 2606:4700:3031::ac43:dee5, 2606:4700:3036::6815:361c
Response IP 104.21.54.28
Found Yes
Hash 585addc0c2f5cea543ece538039e28a1ee78cc0b388d996947901411118feda4
SimHash 9215cc0af7c1

Groups

*

Rule Path
Disallow /search
Disallow /tag
Disallow /search*query%3D*
Disallow /cat/*

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

scrapbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

unileipzigasv

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

typhoeus

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • See also http://en.wikipedia.org/wiki/Robots_exclusion_standard for extensions
  • block searches' queries
  • The policy is to block any SEO/Marketing bot that's too aggressive
  • If you annoy our sysadmins you will be blocked.
  • Reach out to porcellis@eletrotupi.com for any questions.
  • Too aggressive, marketing/SEO
  • Too aggressive, marketing/SEO
  • Marketing/SEO
  • Marketing/SEO
  • Marketing/SEO
  • Too aggressive
  • Too aggressive
  • Too aggressive
  • Too aggressive
  • Dickhead, too aggressive
  • Knowledge AI
Back to top

Warnings

  • 6 invalid lines.
Back to top