Log In Sign Up

meutudo.app
robots.txt

Robots Exclusion Standard data for meutudo.app

Resource Scan

Scan Details

Site Domain meutudo.app
Base Domain meutudo.app
Scan Status Ok
Last Scan2024-11-14T04:04:14+00:00
Next Scan 2024-12-14T04:04:14+00:00

Last Scan

Scanned2024-11-14T04:04:14+00:00
URL https://meutudo.app/robots.txt
Redirect https://meutudo.com.br/robots.txt
Redirect Domain meutudo.com.br
Redirect Base meutudo.com.br
Domain IPs 13.33.28.26, 13.33.28.84, 13.33.28.89, 13.33.28.9
Redirect IPs 108.156.133.107, 108.156.133.127, 108.156.133.54, 108.156.133.83
Response IP 108.156.133.107
Found Yes
Hash 46491ff367e99684728161ad3222d70c3a362fcd0c326c42b28632afc480fdeb
SimHash 49005e708a30

Groups

*

Rule Path
Disallow /blog/wp-admin/
Disallow /blog/wp-includes/
Disallow /blog/wp-login.php
Disallow /blog/?s=*
Disallow /blog/busca/*
Disallow /*?s=
Disallow /*?redirect
Disallow /*?action=login
Disallow /*?action=register
Disallow /*?interim-login=
Allow /blog/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 1

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://meutudo.com.br/sitemap-0.xml
sitemap https://meutudo.com.br/blog/sitemap_index.xml
Back to top

Comments

  • *
  • Crawl-delay
  • GPTBot
  • ChatGPT-User
  • CCBot
  • Omgilibot
  • Claude-Web
  • anthropic-ai
  • cohere-ai
  • Sitemaps
Back to top