secure.telegraph.co.uk
robots.txt

Robots Exclusion Standard data for secure.telegraph.co.uk

Resource Scan

Scan Details

Site Domain secure.telegraph.co.uk
Base Domain telegraph.co.uk
Scan Status Ok
Last Scan2024-09-21T14:48:38+00:00
Next Scan 2024-09-28T14:48:38+00:00

Last Scan

Scanned2024-09-21T14:48:38+00:00
URL https://secure.telegraph.co.uk/robots.txt
Domain IPs 23.210.103.68
Response IP 104.111.206.240
Found Yes
Hash 1a81c6ba8b185f0d911e809f4dd74e17fb9949943a3cd76bff1de41730442282
SimHash bb901b722b72

Groups

*

Rule Path
Disallow /
Disallow /*?*
Allow /customer/secure/login/$
Allow /customer/subscribe/offers/int/$
Allow /customer/secure/newsletter/brexit-bulletin/$
Allow /customer/secure/newsletter/technology-intelligence/$
Allow /customer/secure/newsletter/investor/$
Allow /customer/secure/newsletter/health$
Allow /customer/secure/newsletter/front-bench/$
Allow /customer/secure/newsletter/football-nerd$
Allow /customer/secure/newsletter/global-health-security$
Allow /customer/secure/newsletter/cars$
Allow /customer/secure/newsletter/business-briefing$
Allow /customer/secure/newsletter/from-the-editor/$
Allow /customer/secure/newsletter/fashion$
Allow /customer/secure/newsletter/culture/$
Allow /customer/secure/newsletter/money2$
Allow /customer/secure/newsletter/travel$
Allow /customer/secure/newsletter/ski-snowboard$
Allow /customer/secure/newsletter/sports-premium$
Allow /customer/secure/newsletter/front-page$
Allow /customer/secure/newsletter/puzzles$
Allow /customer/secure/newsletter/cricket-nerd$
Allow /customer/secure/newsletter/bookshop/$
Allow /customer/secure/newsletter/travel-deals/$
Allow /customer/secure/newsletter/telegraph-events/$
Allow /customer/secure/newsletter/garden$
Allow /customer/secure/newsletter/shop/$
Allow /customer/secure/newsletter/tickets/$
Allow /customer/secure/newsletter/travel-solutions/$
Allow /customer/secure/newsletter/cookbook$
Allow /customer/secure/newsletter/gardening$
Allow /customer/secure/newsletter/other-news$
Allow /customer/secure/newsletter/promotions/$
Allow /customer/secure/newsletter/talking-tv$
Allow /customer/secure/newsletter/dispatches$
Allow /customer/secure/newsletter/news-headlines/$
Allow /customer/secure/newsletter/football-headlines/$

Comments

  • Production Robots.txt file for secure.telegraph.co.uk
  • All robots will spider the domain