time.com
robots.txt

Robots Exclusion Standard data for time.com

Resource Scan

Scan Details

Site Domain time.com
Base Domain time.com
Scan Status Ok
Last Scan2024-11-01T10:19:39+00:00
Next Scan 2024-11-08T10:19:39+00:00

Last Scan

Scanned2024-11-01T10:19:39+00:00
URL https://time.com/robots.txt
Domain IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Response IP 151.101.67.52
Found Yes
Hash 604b0fbdf4dc2d7b963b447456d15a815652bdab13e22219b5a31a5e8c9bdb99
SimHash ee6208b40cc6

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php/
Disallow /wp-admin/

googlebot

Rule Path
Disallow /?search*
Disallow */munich/index_html*
Disallow /*?__rmid___get___page
Disallow /*?*__hsfp
Disallow /*?*__hstc
Disallow /*?*__rmid
Disallow /*?*__rmidpage
Disallow /*?*%2F*ref
Disallow /*?*002%2F*0902
Disallow /*?*2&hubs_content
Disallow /*?*ajs_event
Disallow /*?*app
Disallow /*?*attachment_id
Disallow /*?*author
Disallow /*?*bcpid
Disallow /*?*bcpidpage
Disallow /*?*cat
Disallow /*?*controlsVisibleOnLoad
Disallow /*?*country
Disallow /*?*curator
Disallow /*?*edition
Disallow /*?*egotecpage
Disallow /*?*fbclid
Disallow /*?*hl
Disallow /*?*hsCtaTracking
Disallow /*?*hubs_signup-cta
Disallow /*?*iframe
Disallow /*?*iid
Disallow /*?*industry
Disallow /*?*inline-read-more
Disallow /*?*kwp_4
Disallow /*?*library
Disallow /*?*limit
Disallow /*?*linkId
Disallow /*?*luicode
Disallow /*?*offset
Disallow /*?*omnil
Disallow /*?*onwardjourney
Disallow /*?*origin
Disallow /*?*page
Disallow /*?*PageSpeed
Disallow /*?*plan
Disallow /*?*poy-poll
Disallow /*?*ref
Disallow /*?*reviews_page
Disallow /*?*scrape
Disallow /*?*scriptPath
Disallow /*?*source
Disallow /*?*sr_source
Disallow /*?*subscription
Disallow /*?*ua
Disallow /*?*utm
Disallow /*?*utm_campaign
Disallow /*?*utm_medium
Disallow /*?*utm_source
Disallow /*?*xid
Disallow /*?bclid=
Disallow /*?bcpid=
Disallow /*?bctid=
Disallow /*?EGOTECpage
Disallow /*?hc_location
Disallow /*?pagespeed
Disallow /*?ref=
Disallow /*?ref=binfind.com
Disallow /*?sa=
Disallow /*?search
Disallow /feed
Disallow /nextadvisor/search/*
Disallow /page/*/?a_aid=
Disallow /page/*/?egotecpage
Disallow /page/*/?hc_location=
Disallow /page/*/?iq_id=
Disallow /page/*/?pcd=
Disallow /page/*/?search=
Disallow /search/?q=*
Disallow /time_tout/*
Disallow /wp-admin/*
Disallow /wp-login/*
Disallow /uncategorized
Disallow /time_cover_hub

Other Records

Field Value
sitemap https://time.com/sitemap.xml
sitemap https://time.com/news-sitemap.xml
sitemap https://time.com/personal-finance/sitemap.xml
sitemap https://time.com/shopping/sitemap.xml
sitemap https://time.com/video-sitemap.xml
sitemap https://time.com/coupons/sitemap.xml
sitemap https://time.com/archive-sitemaps.xml