fatosdesconhecidos.com.br
robots.txt

Robots Exclusion Standard data for fatosdesconhecidos.com.br

Resource Scan

Scan Details

Site Domain fatosdesconhecidos.com.br
Base Domain fatosdesconhecidos.com.br
Scan Status Ok
Last Scan2024-10-03T07:42:54+00:00
Next Scan 2024-10-10T07:42:54+00:00

Last Scan

Scanned2024-10-03T07:42:54+00:00
URL https://fatosdesconhecidos.com.br/robots.txt
Domain IPs 172.66.40.222, 172.66.43.34, 2606:4700:3108::ac42:28de, 2606:4700:3108::ac42:2b22
Response IP 172.66.43.34
Found Yes
Hash 870107dd97f883e742d8464874a72b490703c465365957c4803c60a20ca9e093
SimHash 4b20cd4f8a32

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Allow /*.css
Allow /*.js
Disallow /wp-admin/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow */disclaimer/*
Disallow *?attachment_id=
Disallow /termos-de-privacidade
Disallow /fale-conosco

petalbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

slurp

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.fatosdesconhecidos.com.br/sitemap_index.xml

Comments

  • Disallow: /wp-includes/