Log In Sign Up

thebeat.asia
robots.txt

Robots Exclusion Standard data for thebeat.asia

Resource Scan

Scan Details

Site Domain thebeat.asia
Base Domain thebeat.asia
Scan Status Ok
Last Scan2024-10-28T10:02:11+00:00
Next Scan 2024-11-04T10:02:11+00:00

Last Scan

Scanned2024-10-28T10:02:11+00:00
URL https://thebeat.asia/robots.txt
Domain IPs 172.66.40.61, 172.66.43.195, 2606:4700:3108::ac42:283d, 2606:4700:3108::ac42:2bc3
Response IP 172.66.40.61
Found Yes
Hash 383cede8045834385e36a889767ee2fd4fc9b02646f35200ff8bfc27e5663ce4
SimHash c81996363ab3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/
Disallow /actions/
Disallow /the-list/deals/day/
Disallow /the-list/events/day/
Disallow /bangkok/the-list/events?event=valentines-events
Disallow /hong-kong/the-list/deals?event=chinese-new-year-deals
Disallow /hong-kong/the-list/deals?event=dining-discounts
Disallow /hong-kong/the-list/deals?event=happy-hours
Disallow /hong-kong/the-list/events?event=chinese-new-year-deals
Disallow /hong-kong/the-list/events?event=chinese-new-year-events
Disallow /hong-kong/the-list/events?event=dinners-tastings
Disallow /hong-kong/the-list/events?event=family-kids
Disallow /hong-kong/the-list/events?event=other
Disallow /hong-kong/the-list/events?event=shopping-markets
Disallow /hong-kong/the-list/events?event=valentines-events
Disallow /macau/the-list/deals?event=chinese-new-year-deals
Disallow /manila/the-list/deals?event=dining-discounts
Disallow /manila/the-list/deals?event=happy-hours
Disallow /manila/the-list/deals?event=valentines-deals
Disallow /manila/the-list/events?event=comedy-theatre
Disallow /manila/the-list/events?event=concerts-live-music
Disallow /manila/the-list/events?event=exhibitions-galleries
Disallow /manila/the-list/events?event=nightlife-clubbing
Disallow /manila/the-list/events?event=other
Disallow /manila/the-list/events?event=talks-networking
Disallow /manila/the-list/events?event=valentines-events
Disallow /singapore/the-list/events?event=chinese-new-year-events
Disallow /singapore/the-list/events?event=exhibitions-galleries
Disallow /singapore/the-list/events?event=family-activities
Disallow /singapore/the-list/events?event=family-kids
Disallow /singapore/the-list/events?event=other
Disallow /singapore/the-list/events?event=sports-health
Disallow /singapore/the-list/events?event=valentines-events
Allow /
Back to top

Other Records

Field Value
sitemap https://thebeat.asia/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/manila/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/hong-kong/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/singapore/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/bangkok/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/macau/sitemaps-1-sitemap.xml
sitemap https://thebeat.asia/kuala-lumpur/sitemaps-1-sitemap.xml
Back to top

Comments

  • robots.txt for https://thebeat.asia/
  • live - don't allow web crawlers to index cpresources/ or vendor/
Back to top

Warnings

  • 1 invalid line.
Back to top