timeout.cat
robots.txt

Robots Exclusion Standard data for timeout.cat

Resource Scan

Scan Details

Site Domain timeout.cat
Base Domain timeout.cat
Scan Status Ok
Last Scan2024-11-09T20:38:44+00:00
Next Scan 2024-11-16T20:38:44+00:00

Last Scan

Scanned2024-11-09T20:38:44+00:00
URL https://timeout.cat/robots.txt
Redirect https://www.timeout.cat/robots.txt
Redirect Domain www.timeout.cat
Redirect Base timeout.cat
Domain IPs 65.9.112.112, 65.9.112.119, 65.9.112.19, 65.9.112.38
Redirect IPs 13.33.88.118, 13.33.88.16, 13.33.88.21, 13.33.88.49, 2600:9000:223b:3a00:11:2d23:5400:93a1, 2600:9000:223b:5e00:11:2d23:5400:93a1, 2600:9000:223b:6e00:11:2d23:5400:93a1, 2600:9000:223b:8000:11:2d23:5400:93a1, 2600:9000:223b:c00:11:2d23:5400:93a1, 2600:9000:223b:d800:11:2d23:5400:93a1, 2600:9000:223b:ee00:11:2d23:5400:93a1, 2600:9000:223b:f600:11:2d23:5400:93a1
Response IP 13.33.88.118
Found Yes
Hash 8ea6bf53a1bfe91c43d35c8c365caa38506c7a350e8334893128e356dccf0397
SimHash 73f75d6c1ed2

Groups

*

Rule Path
Disallow /graffiti/v1/
Disallow /user/ajax/
Disallow */pages-ajax
Disallow */feed.rss
Disallow */paginate
Disallow /user/mtoPopupLogin
Disallow /ajax/mastercard-theme
Disallow */user/sign-up
Disallow *user/myAccount
Disallow *user/forgotPassword
Disallow */user/email/review
Disallow */user/token
Disallow /user//attending/upcoming*
Disallow */rss
Disallow */rss_en_all
Disallow */rss_ja_all
Disallow */rss/Features
Disallow */rss/Events
Disallow */rss_for_twitter
Disallow */rss/Venues
Disallow /search*
Disallow /*/search*
Disallow /*/search/
Disallow /*/search
Disallow /*/*/search*
Disallow /*/*/search/
Disallow /*/*/search
Disallow /search-listings?*
Disallow /*/*.php
Disallow /*/*/bookings

becomebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

geniebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

spock

Rule Path
Disallow /

turnitinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.timeout.com/sitemap.xml.gz
sitemap https://www.timeout.com/bangkok/news_sitemap.xml
sitemap https://www.timeout.com/bangkok/th/news_sitemap.xml
sitemap https://www.timeout.com/chicago/news_sitemap.xml
sitemap https://www.timeout.com/croatia/news_sitemap.xml
sitemap https://www.timeout.com/hong-kong/news_sitemap.xml
sitemap https://www.timeout.com/israel/news_sitemap.xml
sitemap https://www.timeout.com/kuala-lumpur/news_sitemap.xml
sitemap https://www.timeout.com/london/news_sitemap.xml
sitemap https://www.timeout.com/los-angeles/news_sitemap.xml
sitemap https://www.timeout.com/melbourne/news_sitemap.xml
sitemap https://www.timeout.com/miami/news_sitemap.xml
sitemap https://www.timeout.com/newyork/news_sitemap.xml
sitemap https://www.timeout.com/new-york-kids/news_sitemap.xml
sitemap https://www.timeout.com/san-francisco/news_sitemap.xml
sitemap https://www.timeout.com/singapore/news_sitemap.xml
sitemap https://www.timeout.com/sri-lanka/news_sitemap.xml
sitemap https://www.timeout.com/sydney/news_sitemap.xml
sitemap https://www.timeout.com/tokyo/news_sitemap.xml
sitemap https://www.timeout.com/usa/news_sitemap.xml

Comments

  • robots.txt file for Time Out .com
  • updated 14th May 2020

Warnings

  • 2 invalid lines.