centotrentuno.com
robots.txt

Robots Exclusion Standard data for centotrentuno.com

Resource Scan

Scan Details

Site Domain centotrentuno.com
Base Domain centotrentuno.com
Scan Status Ok
Last Scan2024-11-09T00:36:58+00:00
Next Scan 2024-11-16T00:36:58+00:00

Last Scan

Scanned2024-11-09T00:36:58+00:00
URL https://centotrentuno.com/robots.txt
Domain IPs 104.21.9.222, 172.67.161.91, 2606:4700:3031::6815:9de, 2606:4700:3035::ac43:a15b
Response IP 104.21.9.222
Found Yes
Hash 4bb4a8cb8249a130edbb0cd74cfb48d2ab15b044be6dd8f237881f34ee183b8c
SimHash 4300d9602bb5

Groups

psbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

msnbot
msnbot-media
bingbot
*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/