paginaamarela.com.br
robots.txt
Robots Exclusion Standard data for paginaamarela.com.br
Resource Scan
Scan Details
Site Domain | paginaamarela.com.br |
Base Domain | paginaamarela.com.br |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-22T05:32:44+00:00 |
Next Scan | 2024-08-20T05:32:44+00:00 |
Last Successful Scan
Scanned | 2023-10-26T05:12:01+00:00 |
URL | https://paginaamarela.com.br/robots.txt |
Domain IPs | 172.66.40.176, 172.66.43.80, 2606:4700:3108::ac42:28b0, 2606:4700:3108::ac42:2b50 |
Response IP | 172.66.40.176 |
Found | Yes |
Hash | eafa40de437ecc43a7f3a7bb23b8d94d2bd0e0a9dabf022d5c6a83e716d2f9bd |
SimHash | 6317706309ee |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /redirecionar/ |
Disallow | /redirect/ |
Disallow | /central/ |
Disallow | /editar/ |
Disallow | /importacao/ |
Disallow | /busca/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 10 invalid lines.
Comments