travelandleisureasia.com
robots.txt

Robots Exclusion Standard data for travelandleisureasia.com

Resource Scan

Scan Details

Site Domain travelandleisureasia.com
Base Domain travelandleisureasia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-18T14:25:29+00:00
Next Scan 2024-06-17T14:25:29+00:00

Last Successful Scan

Scanned2024-04-19T14:03:11+00:00
URL https://travelandleisureasia.com/robots.txt
Redirect https://www.travelandleisureasia.com:443/robots.txt
Redirect Domain www.travelandleisureasia.com
Redirect Base travelandleisureasia.com
Domain IPs 15.197.168.97
Redirect IPs 13.224.163.17, 13.224.163.3, 13.224.163.47, 13.224.163.98, 2600:9000:2135:1c00:2:5cd7:e740:93a1, 2600:9000:2135:2800:2:5cd7:e740:93a1, 2600:9000:2135:3000:2:5cd7:e740:93a1, 2600:9000:2135:6800:2:5cd7:e740:93a1, 2600:9000:2135:7600:2:5cd7:e740:93a1, 2600:9000:2135:7c00:2:5cd7:e740:93a1, 2600:9000:2135:d600:2:5cd7:e740:93a1, 2600:9000:2135:e400:2:5cd7:e740:93a1
Response IP 108.157.254.87
Found Yes
Hash 96f99f153b5051c3e38b3a537e57e82cd8103798f5814faaabef4fb4808c26a9
SimHash 53cce3908e51

Groups

*

Rule Path
Disallow */feed/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /private/
Disallow /embed
Disallow /oembed
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /*?amp=*
Disallow /cron/*

anthropic-ai

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendiction.com

Rule Path
Disallow /

trendiction.de

Rule Path
Disallow /

urx-api/*

Rule Path
Disallow /

urxbot/*

Rule Path
Disallow /
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /*.jhtml
Disallow /*___itemUrl___
Disallow /embed
Disallow /oembed
Disallow /dyn/
Disallow /labs/
Disallow /order/
Disallow /child/
Disallow /photos/
Disallow /common/
Disallow /content/
Disallow /private/
Disallow /premium/
Disallow /partner/
Disallow /templates/
Disallow /community/kudos/
Disallow /community/user/
Disallow /templatedata/
Disallow /videos/theme/
Disallow /videos/widgets/
Disallow /search*
Disallow /account
Disallow /sweepstakes/rules/
Disallow /sweepstakes/facts/
Disallow /author/*?content=swears
Disallow */feed/*
Disallow *.pdf$
Disallow */?the_ad_placement
Disallow /wp-content/plugins/

googlebot

Rule Path
Disallow */feed/
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /private/
Disallow /embed
Disallow /oembed
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /*?amp=*
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /*.jhtml
Disallow /*___itemUrl___
Disallow /embed
Disallow /oembed
Disallow /dyn/
Disallow /labs/
Disallow /order/
Disallow /child/
Disallow /photos/
Disallow /common/
Disallow /content/
Disallow /private/
Disallow /premium/
Disallow /partner/
Disallow /templates/
Disallow /community/kudos/
Disallow /community/user/
Disallow /templatedata/
Disallow /videos/theme/
Disallow /videos/widgets/
Disallow /search*
Disallow /syndication/
Disallow /account
Disallow /sweepstakes/rules/
Disallow /sweepstakes/facts/
Disallow /author/*?content=swears
Disallow /directory/*
Disallow /directories/
Disallow */newsletter/*
Disallow /*?amp=*
Disallow */tag/*/amp/
Disallow /*/tag/*/amp/

Other Records

Field Value
sitemap https://www.travelandleisureasia.com/in/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/in/news-sitemap.xml
sitemap https://www.travelandleisureasia.com/in/news-sitemap-webstory.xml
sitemap https://www.travelandleisureasia.com/in/web_story-sitemap.xml
sitemap https://www.travelandleisureasia.com/global/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/global/news-sitemap.xml
sitemap https://www.travelandleisureasia.com/hk/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/hk/news-sitemap.xml
sitemap https://www.travelandleisureasia.com/sg/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/sg/news-sitemap.xml
sitemap https://www.travelandleisureasia.com/th/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/th/news-sitemap.xml
sitemap https://www.travelandleisureasia.com/my/sitemap_index.xml
sitemap https://www.travelandleisureasia.com/my/news-sitemap.xml

Comments

  • legacy
  • Onecms
  • content
  • legacy
  • Onecms
  • content