Log In Sign Up

citizenm.com
robots.txt

Robots Exclusion Standard data for citizenm.com

Resource Scan

Scan Details

Site Domain citizenm.com
Base Domain citizenm.com
Scan Status Ok
Last Scan2024-11-03T00:57:57+00:00
Next Scan 2024-11-17T00:57:57+00:00

Last Scan

Scanned2024-11-03T00:57:57+00:00
URL https://citizenm.com/robots.txt
Redirect https://www.citizenm.com/robots.txt
Redirect Domain www.citizenm.com
Redirect Base citizenm.com
Domain IPs 52.178.15.86
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 1ab2a3c4d80ced036bcbf7e13309c41155f0442d3c587a41206d4c7b72f36b4f
SimHash 321c7550cc1c

Groups

*

Rule Path
Disallow /404
Disallow /book?hotelCodes=*
Disallow /book?nuxt&hotelCodes=*
Disallow /mycitizenm/
Disallow /nl/mijncitizenm/
Disallow /fr/moncitizenm/
Disallow /my/
Disallow /es/my/
Disallow /it/my/
Disallow /nl/my/
Disallow /fr/my/
Disallow /zh/my/
Disallow /get-booking/
Disallow /es/get-booking/
Disallow /it/get-booking/
Disallow /nl/get-booking/
Disallow /fr/get-booking/
Disallow /zh/get-booking/

rogerbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

proximic

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

beetlebot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

melodibot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

buddhabot

Rule Path
Disallow /

imrbot

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

gufybot

Rule Path
Disallow /

nesotebot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

noyabot

Rule Path
Disallow /

flappybot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

nutch

Rule Path
Disallow /

berlin-fu-cow

Rule Path
Disallow /

riddler

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-requests/2.8.1

Rule Path
Disallow /
Allow /
Back to top

Other Records

Field Value
sitemap https://www.citizenm.com/sitemapindex.xml
Back to top

Comments

  • ___ __ ______ __ ____ ____ __ __ ___ ___
  • // || | || | || // || ||\ || ||\\//||
  • (( || || || // ||== ||\\|| || \/ ||
  • \\__ || || || //__ ||___ || \|| || ||
  • =================================================================
  • ===> agent <===
  • =================================================================
  • =================================================================
  • ===> Excludes for bots <===
  • =================================================================
  • =================================================================
  • ===> Disallowed Specific Bots <===
  • =================================================================
  • =================================================================
  • ===> Allow: all others <===
  • =================================================================
  • =================================================================
  • ===> end <===
  • =================================================================
Back to top

Warnings

  • 4 invalid lines.
Back to top