lusa.pt
robots.txt
Robots Exclusion Standard data for lusa.pt
Resource Scan
Scan Details
| Site Domain | lusa.pt |
| Base Domain | lusa.pt |
| Scan Status | Ok |
| Last Scan | 2024-10-09T02:58:35+00:00 |
| Next Scan | 2024-11-08T02:58:35+00:00 |
Last Scan
| Scanned | 2024-10-09T02:58:35+00:00 |
| URL | https://lusa.pt/robots.txt |
| Redirect | https://www.lusa.pt/robots.txt |
| Redirect Domain | www.lusa.pt |
| Redirect Base | lusa.pt |
| Domain IPs | 104.22.8.63, 104.22.9.63, 172.67.13.11, 2606:4700:10::6816:83f, 2606:4700:10::6816:93f, 2606:4700:10::ac43:d0b |
| Redirect IPs | 104.22.8.63, 104.22.9.63, 172.67.13.11, 2606:4700:10::6816:83f, 2606:4700:10::6816:93f, 2606:4700:10::ac43:d0b |
| Response IP | 104.22.9.63 |
| Found | Yes |
| Hash | f64b22bb45805857807c34fb428399a2e11fa00def59e940a9ef5fcf69c24936 |
| SimHash | 0918d828c553 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /Admin/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /bin/ |
| Disallow | /Content/ |
| Disallow | /logs/ |
| Disallow | /styles/ |
| Disallow | /Scripts/ |
| Disallow | /Portal/ |
| Disallow | /Handlers/ |
| Allow | /national |
| Allow | /economia |
| Allow | /culture |
| Allow | /desporto |
| Allow | /international |
| Allow | /lusofonia |
| Allow | /lusanews |
| Allow | /newsletters |
| Allow | /about-lusa |
| Allow | /contact-us |
| Allow | /video-gallery |
| Allow | /image-gallery |
| Allow | /article/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /Admin/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /bin/ |
| Disallow | /Content/ |
| Disallow | /logs/ |
| Disallow | /styles/ |
| Disallow | /Scripts/ |
| Disallow | /Portal/ |
| Disallow | /Handlers/ |
| Allow | /national |
| Allow | /economia |
| Allow | /culture |
| Allow | /desporto |
| Allow | /international |
| Allow | /lusofonia |
| Allow | /lusanews |
| Allow | /newsletters |
| Allow | /about-lusa |
| Allow | /contact-us |
| Allow | /video-gallery |
| Allow | /image-gallery |
| Allow | /article/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
facebookbot
| Rule | Path |
|---|---|
| Disallow | /Admin/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /bin/ |
| Disallow | /Content/ |
| Disallow | /logs/ |
| Disallow | /styles/ |
| Disallow | /Scripts/ |
| Disallow | /Portal/ |
| Disallow | /Handlers/ |
| Allow | /national |
| Allow | /economia |
| Allow | /culture |
| Allow | /desporto |
| Allow | /international |
| Allow | /lusofonia |
| Allow | /lusanews |
| Allow | /newsletters |
| Allow | /about-lusa |
| Allow | /contact-us |
| Allow | /video-gallery |
| Allow | /image-gallery |
| Allow | /article/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
*
| Rule | Path |
|---|---|
| Disallow | /Admin/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /bin/ |
| Disallow | /Content/ |
| Disallow | /logs/ |
| Disallow | /styles/ |
| Disallow | /Scripts/ |
| Disallow | /Portal/ |
| Disallow | /Handlers/ |
| Disallow | /article/ |
| Allow | /national |
| Allow | /economia |
| Allow | /culture |
| Allow | /desporto |
| Allow | /international |
| Allow | /lusofonia |
| Allow | /lusanews |
| Allow | /newsletters |
| Allow | /about-lusa |
| Allow | /contact-us |
| Allow | /video-gallery |
| Allow | /image-gallery |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |