timeout.pt
robots.txt

Robots Exclusion Standard data for timeout.pt

Resource Scan

Scan Details

Site Domain timeout.pt
Base Domain timeout.pt
Scan Status Ok
Last Scan2024-05-15T00:59:47+00:00
Next Scan 2024-05-22T00:59:47+00:00

Last Scan

Scanned2024-05-15T00:59:47+00:00
URL https://timeout.pt/robots.txt
Redirect https://www.timeout.pt/robots.txt
Redirect Domain www.timeout.pt
Redirect Base timeout.pt
Domain IPs 18.161.6.123, 18.161.6.37, 18.161.6.60, 18.161.6.91, 2600:9000:21ff:4000:1a:f4be:8a00:93a1, 2600:9000:21ff:8e00:1a:f4be:8a00:93a1, 2600:9000:21ff:9a00:1a:f4be:8a00:93a1, 2600:9000:21ff:9e00:1a:f4be:8a00:93a1, 2600:9000:21ff:ce00:1a:f4be:8a00:93a1, 2600:9000:2203:4800:1a:f4be:8a00:93a1, 2600:9000:2203:4a00:1a:f4be:8a00:93a1, 2600:9000:2203:9600:1a:f4be:8a00:93a1
Redirect IPs 13.33.88.118, 13.33.88.16, 13.33.88.21, 13.33.88.49, 2600:9000:223b:1800:11:2d23:5400:93a1, 2600:9000:223b:5600:11:2d23:5400:93a1, 2600:9000:223b:5800:11:2d23:5400:93a1, 2600:9000:223b:6000:11:2d23:5400:93a1, 2600:9000:223b:6e00:11:2d23:5400:93a1, 2600:9000:223b:7400:11:2d23:5400:93a1, 2600:9000:223b:c000:11:2d23:5400:93a1, 2600:9000:223b:dc00:11:2d23:5400:93a1
Response IP 13.33.88.21
Found Yes
Hash 8ea6bf53a1bfe91c43d35c8c365caa38506c7a350e8334893128e356dccf0397
SimHash 73f75d6c1ed2

Groups

*

Rule Path
Disallow /graffiti/v1/
Disallow /user/ajax/
Disallow */pages-ajax
Disallow */feed.rss
Disallow */paginate
Disallow /user/mtoPopupLogin
Disallow /ajax/mastercard-theme
Disallow */user/sign-up
Disallow *user/myAccount
Disallow *user/forgotPassword
Disallow */user/email/review
Disallow */user/token
Disallow /user//attending/upcoming*
Disallow */rss
Disallow */rss_en_all
Disallow */rss_ja_all
Disallow */rss/Features
Disallow */rss/Events
Disallow */rss_for_twitter
Disallow */rss/Venues
Disallow /search*
Disallow /*/search*
Disallow /*/search/
Disallow /*/search
Disallow /*/*/search*
Disallow /*/*/search/
Disallow /*/*/search
Disallow /search-listings?*
Disallow /*/*.php
Disallow /*/*/bookings

becomebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

geniebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

spock

Rule Path
Disallow /

turnitinbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.timeout.com/sitemap.xml.gz
sitemap https://www.timeout.com/bangkok/news_sitemap.xml
sitemap https://www.timeout.com/bangkok/th/news_sitemap.xml
sitemap https://www.timeout.com/chicago/news_sitemap.xml
sitemap https://www.timeout.com/croatia/news_sitemap.xml
sitemap https://www.timeout.com/hong-kong/news_sitemap.xml
sitemap https://www.timeout.com/israel/news_sitemap.xml
sitemap https://www.timeout.com/kuala-lumpur/news_sitemap.xml
sitemap https://www.timeout.com/london/news_sitemap.xml
sitemap https://www.timeout.com/los-angeles/news_sitemap.xml
sitemap https://www.timeout.com/melbourne/news_sitemap.xml
sitemap https://www.timeout.com/miami/news_sitemap.xml
sitemap https://www.timeout.com/newyork/news_sitemap.xml
sitemap https://www.timeout.com/new-york-kids/news_sitemap.xml
sitemap https://www.timeout.com/san-francisco/news_sitemap.xml
sitemap https://www.timeout.com/singapore/news_sitemap.xml
sitemap https://www.timeout.com/sri-lanka/news_sitemap.xml
sitemap https://www.timeout.com/sydney/news_sitemap.xml
sitemap https://www.timeout.com/tokyo/news_sitemap.xml
sitemap https://www.timeout.com/usa/news_sitemap.xml

Comments

  • robots.txt file for Time Out .com
  • updated 14th May 2020

Warnings

  • 2 invalid lines.