terraplenagem.net
robots.txt

Robots Exclusion Standard data for terraplenagem.net

Resource Scan

Scan Details

Site Domain terraplenagem.net
Base Domain terraplenagem.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-12T07:52:12+00:00
Next Scan 2025-10-12T07:52:12+00:00

Last Successful Scan

Scanned2025-08-14T07:27:55+00:00
URL https://terraplenagem.net/robots.txt
Domain IPs 186.250.244.98
Response IP 186.250.244.98
Found Yes
Hash ffd1f7e13427c68f29e4e120fbf55282b32161c661ff947a6a20ec33a4c0b888
SimHash 8314c5c05c11

Groups

*

Rule Path
Disallow /portal/wp-admin/
Disallow /portal/wp-content/
Disallow /portal/wp-includes/
Disallow /portal/
Allow /

mediapartners-google

Rule Path
Disallow

nbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.terraplenagem.net/sitemap_index.xml

Comments

  • Bloqueia bots consumidores de recursos