sbtnordeste.com.br
robots.txt
Robots Exclusion Standard data for sbtnordeste.com.br
Resource Scan
Scan Details
| Site Domain | sbtnordeste.com.br |
| Base Domain | sbtnordeste.com.br |
| Scan Status | Ok |
| Last Scan | 2024-11-13T13:08:35+00:00 |
| Next Scan | 2024-11-20T13:08:35+00:00 |
Last Scan
| Scanned | 2024-11-13T13:08:35+00:00 |
| URL | https://sbtnordeste.com.br/robots.txt |
| Domain IPs | 186.195.65.65 |
| Response IP | 186.195.65.65 |
| Found | Yes |
| Hash | 1c8868ae1ce87f29831bb223b03a36db76b66b71e737fe6ad74e321e4ec066ff |
| SimHash | 28405ea3d9f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_temp/ |
| Disallow | /src/ |
| Disallow | /cdn/ |
| Disallow | /assets/ |
| Disallow | /*.pdf$ |
| Disallow | /*.json$ |
| Disallow | /search/* |
| Disallow | /tags/*/page/* |
| Disallow | /tags/ |
| Disallow | /validate/* |
| Allow | /*.jpg |
| Allow | /*.JPG |
| Allow | /*.jpeg |
| Allow | /*.JPEG |
| Allow | /*.png |
| Allow | /*.PNG |
| Allow | /*.gif |
| Allow | /*.GIF |
Comments