thisismoney.co.uk
robots.txt

Robots Exclusion Standard data for thisismoney.co.uk

Resource Scan

Scan Details

Site Domain thisismoney.co.uk
Base Domain thisismoney.co.uk
Scan Status Ok
Last Scan2024-09-21T06:56:41+00:00
Next Scan 2024-09-28T06:56:41+00:00

Last Scan

Scanned2024-09-21T06:56:41+00:00
URL https://thisismoney.co.uk/robots.txt
Redirect https://www.thisismoney.co.uk/robots.txt
Redirect Domain www.thisismoney.co.uk
Redirect Base thisismoney.co.uk
Domain IPs 23.210.103.153, 2600:1413:b000:691::16c4, 2600:1413:b000:699::16c4
Redirect IPs 23.210.103.153, 2600:1413:1:986::16c4
Response IP 23.41.64.24
Found Yes
Hash 78f5424519fc5e7c7990c5f2260a43e0e2d96957bc4b94f099b78f46bc409ef9
SimHash 37763ee5cb2b

Groups

*

Rule Path
Disallow /registration/*
Disallow /coffeebreak/
Disallow /healthghost/
Disallow /home/
Disallow /homeghost/
Disallow /mailonsundayghost/
Disallow /moslive/
Disallow /mostread/
Disallow /motoring/
Disallow /news/
Disallow /property/
Disallow /video/
Disallow /textbased/
Disallow /legacygallery/
Disallow /error
Disallow /*redirect.php?
Disallow *reportAbuse*
Disallow /*search.html?searchPhrase=$
Disallow /*search.html?pageOffset
Disallow /*previousThread.html
Disallow /*createThread.html
Disallow /*emailArticle.html$
Disallow /*nextThread.html
Disallow /*readLater.html$
Disallow /*myStories.html$
Disallow /*search.html?s=y&authornamef=
Disallow /*logout?redirectPath=
Disallow /*login?redirectPath=
Disallow /*createThread.html
Disallow /*refer_product.php?
Disallow /*startIndex%3D
Disallow /*?pageSize
Disallow /*?start=
Disallow /SITE%3DDM/
Disallow /js
Disallow /*debateUserSearch.html
Disallow /*debateSearchResults.html
Disallow /*debateTagSearch.html
Disallow /*textbased/channel
Disallow /*goto.php?
Disallow /*?printingPage=true$
Disallow */chat/*

meltwater

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thisismoney.co.uk/newssitemap.xml
sitemap https://www.thisismoney.co.uk/sitemap-articles-year~2020.xml
sitemap https://www.thisismoney.co.uk/sitemap-articles-year~2021.xml
sitemap https://www.thisismoney.co.uk/sitemap-facts-year~2020.xml
sitemap https://www.thisismoney.co.uk/sitemap-facts-year~2021.xml
sitemap https://www.thisismoney.co.uk/sitemap-videos-year~2020.xml
sitemap https://www.thisismoney.co.uk/sitemap-videos-year~2021.xml
sitemap https://www.thisismoney.co.uk/sitemap-articles-year~2022.xml
sitemap https://www.thisismoney.co.uk/sitemap-facts-year~2022.xml
sitemap https://www.thisismoney.co.uk/sitemap-videos-year~2022.xml

Comments

  • Robots.txt for https://www.thisismoney.co.uk/ updated 26/09/2023
  • Meltwater block
  • Begin standard rules
  • Allowing adsense bot
  • ChatGPT
  • Sitemap files