Log In Sign Up

sbtnews.com.br
robots.txt

Robots Exclusion Standard data for sbtnews.com.br

Resource Scan

Scan Details

Site Domain sbtnews.com.br
Base Domain sbtnews.com.br
Scan Status Ok
Last Scan2024-09-24T08:15:30+00:00
Next Scan 2024-10-01T08:15:30+00:00

Last Scan

Scanned2024-09-24T08:15:30+00:00
URL https://sbtnews.com.br/robots.txt
Redirect https://sbtnews.sbt.com.br/robots.txt
Redirect Domain sbtnews.sbt.com.br
Redirect Base sbt.com.br
Domain IPs 3.165.82.18, 3.165.82.20, 3.165.82.39, 3.165.82.55
Redirect IPs 13.35.210.100, 13.35.210.116, 13.35.210.45, 13.35.210.78, 2600:9000:2078:2200:1a:6c80:ac80:93a1, 2600:9000:2078:4a00:1a:6c80:ac80:93a1, 2600:9000:2078:6400:1a:6c80:ac80:93a1, 2600:9000:2078:6800:1a:6c80:ac80:93a1, 2600:9000:2078:7200:1a:6c80:ac80:93a1, 2600:9000:2078:7400:1a:6c80:ac80:93a1, 2600:9000:2078:8000:1a:6c80:ac80:93a1, 2600:9000:2078:e800:1a:6c80:ac80:93a1
Response IP 13.35.210.100
Found Yes
Hash b99c773e17f27f32eebfb2d97f0c63a5c0044a55c5d86f12a30e72451e7f471a
SimHash 2b0c91458a13

Groups

*

Rule Path
Allow /

test-bot

Rule Path
Allow /path
Allow /path-2

black-listed-bot

Rule Path
Disallow /sub-path-1
Disallow /path-2
Back to top

Other Records

Field Value
sitemap https://sbtnews.sbt.com.br/sitemap.xml
Back to top

Comments

  • *
  • test-bot
  • black-listed-bot
  • Sitemaps
Back to top