blondjesbeleggenbeter.nl
robots.txt
Robots Exclusion Standard data for blondjesbeleggenbeter.nl
Resource Scan
Scan Details
Site Domain | blondjesbeleggenbeter.nl |
Base Domain | blondjesbeleggenbeter.nl |
Scan Status | Ok |
Last Scan | 2024-09-24T21:43:15+00:00 |
Next Scan | 2024-10-24T21:43:15+00:00 |
Last Scan
Scanned | 2024-09-24T21:43:15+00:00 |
URL | https://blondjesbeleggenbeter.nl/robots.txt |
Domain IPs | 2001:1460:3:5:1c00:cfff:fe00:24ff, 62.221.192.174 |
Response IP | 62.221.192.174 |
Found | Yes |
Hash | 9af0ff8e6ef6c1a4f546478714349c266e7e2ecd107461a5cd2fdc6e666da8f3 |
SimHash | ce93ce228cb9 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-content/plugins/ |
Disallow | /xmlrpc.php |
Disallow | /feed/ |
Disallow | /wp-json/ |
blexbot
baiduspider
barkrowler
gigabot
go-http-client
nuclei
riddler
seznambot
wikido
yandex
zoominfobot
magpie-crawler
adsbot-google
mj12bot
yandeximages
ahrefsbot
node/simplecrawler
cazoodlebot
dotbot/1.0
petalbot
zoominfobot
node/simplecrawler
cazoodlebot
dotbot/1.0
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Allow | /wp-admin/admin-ajax.php |