lineup-br.com
robots.txt
Robots Exclusion Standard data for lineup-br.com
Resource Scan
Scan Details
Site Domain | lineup-br.com |
Base Domain | lineup-br.com |
Scan Status | Ok |
Last Scan | 2024-11-08T12:24:31+00:00 |
Next Scan | 2024-11-15T12:24:31+00:00 |
Last Scan
Scanned | 2024-11-08T12:24:31+00:00 |
URL | https://lineup-br.com/robots.txt |
Domain IPs | 185.28.21.87, 2a02:4780:1:635:0:16a8:b7ff:2 |
Response IP | 185.28.21.87 |
Found | Yes |
Hash | bf768bcee57648c75f77d32f91085d7a7365c1cfabfd4358efd3aba34c7e341f |
SimHash | 642864250bc6 |
Groups
flipboard
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /banner |
Disallow | /canais |
Disallow | /images |
Disallow | /m |
Disallow | /operadoras |
Disallow | /programadoras |
Disallow | /radios |
Disallow | /s1 |
Disallow | /*gdc* |
flipboardproxy
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /banner |
Disallow | /canais |
Disallow | /images |
Disallow | /m |
Disallow | /operadoras |
Disallow | /programadoras |
Disallow | /radios |
Disallow | /s1 |
Disallow | /*gdc* |
webgrab+plus
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /banner |
Disallow | /canais |
Disallow | /images |
Disallow | /m |
Disallow | /operadoras |
Disallow | /programadoras |
Disallow | /radios |
Disallow | /s1 |
Disallow | /*gdc* |
wget
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /banner |
Disallow | /canais |
Disallow | /images |
Disallow | /m |
Disallow | /operadoras |
Disallow | /programadoras |
Disallow | /radios |
Disallow | /s1 |
Disallow | /*gdc* |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |