Log In Sign Up

hostsec.com.br
robots.txt

Robots Exclusion Standard data for hostsec.com.br

Resource Scan

Scan Details

Site Domain hostsec.com.br
Base Domain hostsec.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-11T15:21:00+00:00
Next Scan 2024-06-09T15:21:00+00:00

Last Successful Scan

Scanned2023-01-17T23:14:46+00:00
URL https://hostsec.com.br/robots.txt
Redirect https://www.secload.com.br/robots.txt
Redirect Domain www.secload.com.br
Redirect Base secload.com.br
Domain IPs 52.71.35.12
Redirect IPs 34.117.168.233
Response IP 34.117.168.233
Found Yes
Hash 68021860f95ad8c71f4f83e2de45b808935028604a1c0d516dda8158f348330a
SimHash 28d28a6ade16

Groups

*

Rule Path
Allow /

adsbot-google-mobile
adsbot-google

Rule Path
Disallow /_api/*
Disallow /_partials*
Disallow /pro-gallery-webapp/v1/galleries/*

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.secload.com.br/sitemap.xml
Back to top

Comments

  • Optimization for Google Ads Bot
  • Block PetalBot
  • Auto generated, go to SEO Tools > Robots.txt Editor to change this
Back to top