topictravel.nl
robots.txt
Robots Exclusion Standard data for topictravel.nl
Resource Scan
Scan Details
Site Domain | topictravel.nl |
Base Domain | topictravel.nl |
Scan Status | Ok |
Last Scan | 2024-05-07T07:14:23+00:00 |
Next Scan | 2024-05-21T07:14:23+00:00 |
Last Scan
Scanned | 2024-05-07T07:14:23+00:00 |
URL | https://topictravel.nl/robots.txt |
Redirect | https://www.topictravel.nl:443/robots.txt |
Redirect Domain | www.topictravel.nl |
Redirect Base | topictravel.nl |
Domain IPs | 18.141.252.199, 52.221.111.213, 52.77.185.119 |
Redirect IPs | 96.17.96.20, 96.17.96.32 |
Response IP | 23.54.118.53 |
Found | Yes |
Hash | 8ee75e513dc31273bc253deb16174b1dd9d1df29df4ca3b1c170270d533167e3 |
SimHash | d3591176a123 |
Groups
*
Rule | Path |
---|---|
Allow | *.jpg$ |
Allow | *.png$ |
Allow | *.webp$ |
Allow | *.js |
Allow | *.css |
Allow | *.woff2$ |
Allow | *.jpeg$ |
Allow | *.mp3$ |
Allow | *.wav$ |
Allow | *.svg$ |
Allow | *.woff$ |
Disallow | /kws |
Disallow | /content/ |
Disallow | /booking_v3/ |
Disallow | /checkout |
Disallow | /checkout/ |
Disallow | /aj_windows/travelagencies/ |
Disallow | /search2 |
Disallow | /search-old |
Disallow | /property/* |
Disallow | /us/ |
Disallow | /my/ |
Disallow | /np/ |
Disallow | /id/ |
Disallow | /cn/ |
Disallow | /ae/ |
Disallow | /sa/ |
Disallow | /gb/ |
Disallow | /ca/ |
Disallow | /ph/ |
Disallow | /vn/ |
Disallow | /sg/ |
Disallow | /th/ |
Disallow | /jp/ |
Disallow | /br/ |
Disallow | /mx/ |
Disallow | /om/ |
Disallow | /bh/ |
Disallow | /kw/ |
Disallow | /eg/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.belvilla.fr/static/feeds/google_sitemaps/v2/bvdir_fr_wwwfr.xml |