tripcentral.ca
robots.txt

Robots Exclusion Standard data for tripcentral.ca

Resource Scan

Scan Details

Site Domain tripcentral.ca
Base Domain tripcentral.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-31T02:24:28+00:00
Next Scan 2024-09-29T02:24:28+00:00

Last Successful Scan

Scanned2024-01-11T01:49:47+00:00
URL https://tripcentral.ca/robots.txt
Redirect https://www.tripcentral.ca/robots.txt
Redirect Domain www.tripcentral.ca
Redirect Base tripcentral.ca
Domain IPs 204.225.220.65
Redirect IPs 204.225.220.65
Response IP 204.225.220.65
Found Yes
Hash 49b0e0ce26e375bfd7f3f65b52893a55c01d05d3fd6644309bba840a74dfa9f6
SimHash 4228134abbb8

Groups

adidxbot
ahrefsbot
aihitbot
alphaseobot
alphaseobot-sa
baiduspider
bingpreview
blexbot
careerbot
cliqzbot
dotbot
grapeshot
ichiro
icjobs
linkdexbot
magpie-crawler
megaindex
mj12bot
moget
naverbot
owlin
owlin bot
owlin bot v. 3.0
proximic
queryseekerspider
scrapy
scrapybot
semrush
semrushbot
sentibot
seokicks-robot
sogou
sogou spider
tkbot
trendkite-akashic-crawler
vagabondo
wbsearchbot
yandex
yandexbot
yeti
youdaobot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /icons/
Disallow /deals/
Disallow /contest/
Disallow /earn/
Disallow /redeem/
Disallow /flights
Disallow /vacation-grid
Disallow /vacationgrid
Disallow /package-details
Disallow /packages
Disallow /tour-finder
Disallow /offers
Disallow /chat
Disallow /fr
Disallow /cruisegrid
Disallow /cruise-finder
Disallow /hotels/search.php

Other Records

Field Value
sitemap https://www.tripcentral.ca/sitemap.xml

Comments

  • Horrible bandwidth eating robots (from melkvee.nl)