Log In Sign Up

palavracomdeus.com
robots.txt

Robots Exclusion Standard data for palavracomdeus.com

Resource Scan

Scan Details

Site Domain palavracomdeus.com
Base Domain palavracomdeus.com
Scan Status Ok
Last Scan2026-01-24T20:09:38+00:00
Next Scan 2026-02-23T20:09:38+00:00

Last Scan

Scanned2026-01-24T20:09:38+00:00
URL https://palavracomdeus.com/robots.txt
Domain IPs 104.21.72.171, 172.67.187.36, 2606:4700:3030::6815:48ab, 2606:4700:3030::ac43:bb24
Response IP 172.67.187.36
Found Yes
Hash feeaa4498aa9d5aaf847da3e463aeeef2bcb49f0de270eef427d72b200f4093b
SimHash 4810afc1b592

Groups

*

Rule Path
Disallow /ghost/

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://palavracomdeus.com/sitemap.xml
Back to top

Comments

  • -----------------------------------------------------
  • robots.txt - Palavra com Deus
  • -----------------------------------------------------
  • - Disallow Ghost admin area for all crawlers.
  • - Block major Chinese and Russian search engine bots.
  • - Block others specific bots.
  • - Allow all other legitimate bots.
  • -----------------------------------------------------
  • Disallow admin area for all crawlers
  • Block major Chinese bots
  • Block major Russian bots
  • Block others specific bots
Back to top

Warnings

  • 2 invalid lines.
Back to top