itv.com
robots.txt
Robots Exclusion Standard data for itv.com
Resource Scan
Scan Details
Site Domain | itv.com |
Base Domain | itv.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-05-24T16:33:43+00:00 |
Next Scan | 2024-08-22T16:33:43+00:00 |
Last Successful Scan
Scanned | 2023-01-20T03:19:42+00:00 |
URL | https://itv.com/robots.txt |
Redirect | https://www.itv.com/robots.txt |
Redirect Domain | www.itv.com |
Redirect Base | itv.com |
Domain IPs | 75.2.43.168, 99.83.221.243 |
Redirect IPs | 23.54.57.15 |
Response IP | 23.54.57.15 |
Found | Yes |
Hash | ba4334561851cf937e3ef503ac73022ecf64bc17822728f6f201da652d363666 |
SimHash | db7015309c84 |
Groups
*
Rule | Path |
---|---|
Disallow | /Lifestyle/Food/Shadowmastermodules/ |
Disallow | /thylacinus/ |
Disallow | /griffin/ |
Disallow | /_app/ |
Disallow | /_data/ |
Disallow | /Error404/ |
Disallow | /Error500/noindex |
Disallow | /deleteme/ |
Disallow | /Help/helpmastershadows/ |
Disallow | /News/MasterModule11News/ |
Disallow | /News/newsmanual |
Disallow | /News/newsfeeds |
Disallow | /tvguide/tvguidepl/ |
Disallow | /error404/ |
Disallow | /adtest/ |
Disallow | /documents/pdf/ |
Disallow | /beta/ |
Disallow | /food/taxonomy/ |
Disallow | /food/recipe/*?filters= |
Disallow | /food/recipe/*%26filters%3D |
Disallow | /news/search/ |
Disallow | /news/border/search/ |
Disallow | /news/tyne-tees/search/ |
Disallow | /news/calendar/search/ |
Disallow | /news/granada/search/ |
Disallow | /news/central/search/ |
Disallow | /news/anglia/search/ |
Disallow | /news/london/search/ |
Disallow | /news/meridian/search/ |
Disallow | /news/wales/search/ |
Disallow | /news/west/search/ |
Disallow | /news/westcountry/search/ |
Disallow | /takemeout/previously/ |
Disallow | /takemeout/the-gossip/ |
Disallow | /takemeout/dating-tips/ |
Disallow | /takemeout/quizzes/ |
Disallow | /termsandconditions |
Disallow | /presscentre/search/ |
Disallow | /onlineentry/ |
Disallow | /search-results/ |
Disallow | /itvsearch/ |
Disallow | /cookies/ |
Disallow | /termsconditions/ |
Disallow | /interstitial/ |
Disallow | /watch/user/ |
Disallow | /watch/assets/js/robotsTxt-*.js$ |
Disallow | /britbox |
Disallow | /watch/britbox |
Other Records
Field | Value |
---|---|
sitemap | https://www.itv.com/sitemap.xml |