vanwagenen.com
robots.txt
Robots Exclusion Standard data for vanwagenen.com
Resource Scan
Scan Details
| Site Domain | vanwagenen.com |
| Base Domain | vanwagenen.com |
| Scan Status | Ok |
| Last Scan | 2024-11-19T17:44:02+00:00 |
| Next Scan | 2024-12-19T17:44:02+00:00 |
Last Scan
| Scanned | 2024-11-19T17:44:02+00:00 |
| URL | https://vanwagenen.com/robots.txt |
| Domain IPs | 107.180.21.23 |
| Response IP | 107.180.21.23 |
| Found | Yes |
| Hash | f1b1be88351a0cb9cc65a5ab66da05959149849e7b206f86bf012ca329bd7ec5 |
| SimHash | 5204db80c033 |
Groups
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
baiduspider
easouspider
coccoc
ichiro
moget
naverbot
ranksonicsiteauditor
seznambot
sogou spider
sogou pic agent
yandex
yeti
youdaobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /author/ |
| Disallow | /comments/feed/ |
| Disallow | /feed/ |
| Disallow | /tags/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/themes/*.php$ |
| Disallow | /wp-content/plugins/*.php$ |
| Disallow | /wp-includes/*.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vanwagenen.com/sitemap.xml |
Comments