pianetablunews.it
robots.txt
Robots Exclusion Standard data for pianetablunews.it
Resource Scan
Scan Details
| Site Domain | pianetablunews.it |
| Base Domain | pianetablunews.it |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-11T20:28:09+00:00 |
| Next Scan | 2024-11-18T20:28:09+00:00 |
Last Successful Scan
| Scanned | 2024-11-03T20:10:11+00:00 |
| URL | https://pianetablunews.it/robots.txt |
| Domain IPs | 2a0c:79c0:2:10::4, 86.105.14.16 |
| Response IP | 86.105.14.16 |
| Found | Yes |
| Hash | 4eef953397e983dc7b2dddcf60b84810ed0cc5693248fb3054f51ee7b13265c7 |
| SimHash | 9369b62b0e2b |
Groups
indy library
xaldon webspider
netants
linkpadbot
bot [email="craftbot@yahoo.com"]mailto:craftbot@yahoo.com[/email]
zeus
go-ahead-got-it
leechftp
mj12bot
widow
reget
httrack
mass downloader
net vampire
nearsite
pcbrowser
emailsiphon
webreaper
extractorpro
websauger
superhttp
superbot
website extractor
webfetch
webcopier
getweb!
custo
webgo is
smartdownload
dotbot
voideye
webzip
pagegrabber
semrushbot
rogerbot
netspider
webleacher
midown tool
webauto
jetcar
ahrefsbot/5.1
offline explorer
joc web spider
teleport pro
surfbot
sitesnagger
wwwoffle
grabnet
emailwolf
larbin
flashget
webwhacker
gigabot
exabot
papa foto
web image collector
image sucker
internet ninja
image stripper
express webpictures
navroad
takeout
netzip
grafula
web sucker
eyenetie
go!zilla
chinaclaw
mister pix
download demon
eirgrabber
offline navigator
octopus
hmview
webstripper
wget
disco
ahrefsbot
pavuk
getright
semrushbot/1.1~bl
realdownload
blackwidow
interget
ecatch
website quester
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |