timeout.es
robots.txt

Robots Exclusion Standard data for timeout.es

Resource Scan

Scan Details

Site Domain timeout.es
Base Domain timeout.es
Scan Status Ok
Last Scan2024-11-08T03:29:58+00:00
Next Scan 2024-11-15T03:29:58+00:00

Last Scan

Scanned2024-11-08T03:29:58+00:00
URL https://timeout.es/robots.txt
Redirect https://www.timeout.es/robots.txt
Redirect Domain www.timeout.es
Redirect Base timeout.es
Domain IPs 13.224.103.102, 13.224.103.124, 13.224.103.35, 13.224.103.38
Redirect IPs 13.33.88.118, 13.33.88.16, 13.33.88.21, 13.33.88.49, 2600:9000:223b:2200:11:2d23:5400:93a1, 2600:9000:223b:4a00:11:2d23:5400:93a1, 2600:9000:223b:5c00:11:2d23:5400:93a1, 2600:9000:223b:7600:11:2d23:5400:93a1, 2600:9000:223b:7c00:11:2d23:5400:93a1, 2600:9000:223b:9400:11:2d23:5400:93a1, 2600:9000:223b:e200:11:2d23:5400:93a1, 2600:9000:223b:ec00:11:2d23:5400:93a1
Response IP 13.33.88.49
Found Yes
Hash 8ea6bf53a1bfe91c43d35c8c365caa38506c7a350e8334893128e356dccf0397
SimHash 73f75d6c1ed2

Groups

*

Rule Path
Disallow /graffiti/v1/
Disallow /user/ajax/
Disallow */pages-ajax
Disallow */feed.rss
Disallow */paginate
Disallow /user/mtoPopupLogin
Disallow /ajax/mastercard-theme
Disallow */user/sign-up
Disallow *user/myAccount
Disallow *user/forgotPassword
Disallow */user/email/review
Disallow */user/token
Disallow /user//attending/upcoming*
Disallow */rss
Disallow */rss_en_all
Disallow */rss_ja_all
Disallow */rss/Features
Disallow */rss/Events
Disallow */rss_for_twitter
Disallow */rss/Venues
Disallow /search*
Disallow /*/search*
Disallow /*/search/
Disallow /*/search
Disallow /*/*/search*
Disallow /*/*/search/
Disallow /*/*/search
Disallow /search-listings?*
Disallow /*/*.php
Disallow /*/*/bookings

becomebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

geniebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

spock

Rule Path
Disallow /

turnitinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.timeout.com/sitemap.xml.gz
sitemap https://www.timeout.com/bangkok/news_sitemap.xml
sitemap https://www.timeout.com/bangkok/th/news_sitemap.xml
sitemap https://www.timeout.com/chicago/news_sitemap.xml
sitemap https://www.timeout.com/croatia/news_sitemap.xml
sitemap https://www.timeout.com/hong-kong/news_sitemap.xml
sitemap https://www.timeout.com/israel/news_sitemap.xml
sitemap https://www.timeout.com/kuala-lumpur/news_sitemap.xml
sitemap https://www.timeout.com/london/news_sitemap.xml
sitemap https://www.timeout.com/los-angeles/news_sitemap.xml
sitemap https://www.timeout.com/melbourne/news_sitemap.xml
sitemap https://www.timeout.com/miami/news_sitemap.xml
sitemap https://www.timeout.com/newyork/news_sitemap.xml
sitemap https://www.timeout.com/new-york-kids/news_sitemap.xml
sitemap https://www.timeout.com/san-francisco/news_sitemap.xml
sitemap https://www.timeout.com/singapore/news_sitemap.xml
sitemap https://www.timeout.com/sri-lanka/news_sitemap.xml
sitemap https://www.timeout.com/sydney/news_sitemap.xml
sitemap https://www.timeout.com/tokyo/news_sitemap.xml
sitemap https://www.timeout.com/usa/news_sitemap.xml

Comments

  • robots.txt file for Time Out .com
  • updated 14th May 2020

Warnings

  • 2 invalid lines.