animalpedia.it
robots.txt
Robots Exclusion Standard data for animalpedia.it
Resource Scan
Scan Details
Site Domain | animalpedia.it |
Base Domain | animalpedia.it |
Scan Status | Ok |
Last Scan | 2024-11-17T05:11:28+00:00 |
Next Scan | 2024-11-24T05:11:28+00:00 |
Last Scan
Scanned | 2024-11-17T05:11:28+00:00 |
URL | https://animalpedia.it/robots.txt |
Redirect | https://www.animalpedia.it/robots.txt |
Redirect Domain | www.animalpedia.it |
Redirect Base | animalpedia.it |
Domain IPs | 104.21.17.87, 172.67.175.100, 2606:4700:3032::ac43:af64, 2606:4700:3033::6815:1157 |
Redirect IPs | 104.21.17.87, 172.67.175.100, 2606:4700:3032::ac43:af64, 2606:4700:3033::6815:1157 |
Response IP | 104.21.17.87 |
Found | Yes |
Hash | 2e81aa1b10d9298e10eb388449337198fae34df3d977162d0bc9593ad73ebc80 |
SimHash | 0bc490434b98 |
Groups
*
Rule | Path |
---|---|
Disallow | /index/ |
Disallow | /search/ |
Disallow | /busqueda |
Disallow | /pesquisa |
Disallow | /recherche |
Disallow | /searcher |
Disallow | /ricerca |
Disallow | /post/index |
Disallow | /raza/index |
Disallow | /raza/lista |
Disallow | /article/lista |
Disallow | /place/lista |
Disallow | /admin/ |
Disallow | /mail/ |
Disallow | /ajax/ |
Disallow | /sitemap/ |
Allow | /index/getitems |
Allow | /ajax/getcomentarios |
Allow | /ajax/getautoritems |
Disallow | /motori/search/ |
Disallow | /bellezza/search/ |
Disallow | /istruzione/search/ |
Disallow | /cucina/search/ |
Disallow | /sport/search/ |
Disallow | /casa/search/ |
Disallow | /tempolibero/search/ |
Disallow | /arte/search/ |
Disallow | /tecnologia/search/ |
Disallow | /relazioni/search/ |
Disallow | /affari/search/ |
Disallow | /animali/search/ |
Disallow | /salute/search/ |
Disallow | /motori/ricerca |
Disallow | /bellezza/ricerca |
Disallow | /istruzione/ricerca |
Disallow | /cucina/ricerca |
Disallow | /sport/ricerca |
Disallow | /casa/ricerca |
Disallow | /tempolibero/ricerca |
Disallow | /arte/ricerca |
Disallow | /tecnologia/ricerca |
Disallow | /relazioni/ricerca |
Disallow | /affari/ricerca |
Disallow | /animali/ricerca |
Disallow | /salute/ricerca |
Disallow | /ut/v3 |