motor1.uol.com.br
robots.txt
Robots Exclusion Standard data for motor1.uol.com.br
Resource Scan
Scan Details
Site Domain | motor1.uol.com.br |
Base Domain | uol.com.br |
Scan Status | Ok |
Last Scan | 2024-05-02T17:34:10+00:00 |
Next Scan | 2024-06-01T17:34:10+00:00 |
Last Scan
Scanned | 2024-05-02T17:34:10+00:00 |
URL | https://motor1.uol.com.br/robots.txt |
Domain IPs | 200.147.36.53 |
Response IP | 200.147.4.47 |
Found | Yes |
Hash | 59ee397a45643d881f4b28c03cded6249e4ba0fb043347ab84024db01a18998b |
SimHash | 4808cc40e531 |
Groups
*
Rule | Path |
---|---|
Disallow | /logout/ |
Disallow | /login/ |
Disallow | /motorshow/ |
Disallow | /search/ |
Disallow | /layout-auth-data/ |
Disallow | /most-recent/ |
Disallow | /get-disqus-count/ |
Other Records
Field | Value |
---|---|
sitemap | https://motor1.uol.com.br/sitemaps/br/sitemap.xml |
Warnings
- `host` is not a known field.