travelground.com
robots.txt

Robots Exclusion Standard data for travelground.com

Resource Scan

Scan Details

Site Domain travelground.com
Base Domain travelground.com
Scan Status Ok
Last Scan2024-09-23T20:48:32+00:00
Next Scan 2024-10-07T20:48:32+00:00

Last Scan

Scanned2024-09-23T20:48:32+00:00
URL https://travelground.com/robots.txt
Redirect https://www.travelground.com/robots.txt
Redirect Domain www.travelground.com
Redirect Base travelground.com
Domain IPs 104.26.12.237, 104.26.13.237, 172.67.72.127, 2606:4700:20::681a:ced, 2606:4700:20::681a:ded, 2606:4700:20::ac43:487f
Redirect IPs 104.26.12.237, 104.26.13.237, 172.67.72.127, 2606:4700:20::681a:ced, 2606:4700:20::681a:ded, 2606:4700:20::ac43:487f
Response IP 104.26.13.237
Found Yes
Hash cbd9fed13fc65c3f2a193835df2e3415c8760eb1575331dc90e4576d3ef587ff
SimHash a03938c0ccf5

Groups

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

*

Rule Path
Disallow /suppliers
Disallow /postenquiry
Disallow /users
Disallow /besprekings
Disallow /bookings
Disallow /favourites
Disallow /gunstelinge
Disallow /flights/api/user/language
Disallow /flights/api/Scripts/
Disallow /scripts
Disallow /teken-af
Disallow /login/
Disallow /uitteken
Disallow /teken-af
Disallow /login
Disallow /login/
Disallow /newsletters
Disallow /cdn-cgi
Allow /cdn-cgi/image/

Other Records

Field Value
sitemap https://www.travelground.com/sitemap.xml?token=FCA8ED9F943243976907823A480D0C91A4CA427A75FE5C4C44DE1A577321616E

Comments

  • Some exceptions:
  • Explicitly allow Cloudflare image resize service

Warnings

  • `visit-time` is not a known field.