lifestyleasia.com
robots.txt

Robots Exclusion Standard data for lifestyleasia.com

Resource Scan

Scan Details

Site Domain lifestyleasia.com
Base Domain lifestyleasia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-19T09:16:33+00:00
Next Scan 2024-06-18T09:16:33+00:00

Last Successful Scan

Scanned2024-04-20T07:15:13+00:00
URL https://lifestyleasia.com/robots.txt
Redirect https://www.lifestyleasia.com/robots.txt
Redirect Domain www.lifestyleasia.com
Redirect Base lifestyleasia.com
Domain IPs 104.21.80.139, 172.67.183.162, 2606:4700:3030::6815:508b, 2606:4700:3031::ac43:b7a2
Redirect IPs 13.227.254.101, 13.227.254.43, 13.227.254.62, 13.227.254.76, 2600:9000:200a:5000:7:a6f6:2940:93a1, 2600:9000:200a:7600:7:a6f6:2940:93a1, 2600:9000:200a:7a00:7:a6f6:2940:93a1, 2600:9000:200a:9400:7:a6f6:2940:93a1, 2600:9000:200a:9a00:7:a6f6:2940:93a1, 2600:9000:200a:b800:7:a6f6:2940:93a1, 2600:9000:200a:de00:7:a6f6:2940:93a1, 2600:9000:200a:ea00:7:a6f6:2940:93a1
Response IP 13.227.254.62
Found Yes
Hash 491293372596a455215fed37d09d34ea354c3d448463df1eebfde56a2a75c437
SimHash 133a9a10efb7

Groups

*

Rule Path
Allow /
Disallow /*/wp-admin
Disallow /*/wp-login.php
Disallow /wp-content/plugins/
Disallow */feed/*
Disallow */search/*
Disallow */?post*
Disallow *?s=*
Disallow *?search=*
Disallow */newsletter/*
Disallow /*?amp=*
Disallow */directory/
Disallow */best-bites-amenities/*
Disallow */best-bites-cuisine/*
Disallow */best-bites-types/*
Disallow */club-masterclass/*
Disallow */testimonial/*
Disallow */workshop/*
Disallow */speakers/*
Disallow */tag/*/amp/
Disallow */directory/*

anthropic-ai

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

boardreader

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

trendiction.com

Rule Path
Disallow /

trendiction.de

Rule Path
Disallow /

urx-api/*

Rule Path
Disallow /

urxbot/*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.lifestyleasia.com/ind/news-sitemap.xml
sitemap https://www.lifestyleasia.com/ind/sitemap_index.xml
sitemap https://www.lifestyleasia.com/hk/news-sitemap.xml
sitemap https://www.lifestyleasia.com/hk/sitemap_index.xml
sitemap https://www.lifestyleasia.com/bk/news-sitemap.xml
sitemap https://www.lifestyleasia.com/bk/sitemap_index.xml
sitemap https://www.lifestyleasia.com/fr/news-sitemap.xml
sitemap https://www.lifestyleasia.com/fr/sitemap_index.xml
sitemap https://www.lifestyleasia.com/kl/news-sitemap.xml
sitemap https://www.lifestyleasia.com/kl/sitemap_index.xml
sitemap https://www.lifestyleasia.com/sg/news-sitemap.xml
sitemap https://www.lifestyleasia.com/sg/sitemap_index.xml
sitemap https://www.lifestyleasia.com/bk-th/sitemap_index.xml
sitemap https://www.lifestyleasia.com/bk-th/news-sitemap.xml
sitemap https://www.lifestyleasia.com/my/news-sitemap.xml
sitemap https://www.lifestyleasia.com/my/sitemap_index.xml