christianscience.com
robots.txt

Robots Exclusion Standard data for christianscience.com

Resource Scan

Scan Details

Site Domain christianscience.com
Base Domain christianscience.com
Scan Status Ok
Last Scan2024-06-01T16:19:43+00:00
Next Scan 2024-07-01T16:19:43+00:00

Last Scan

Scanned2024-06-01T16:19:43+00:00
URL https://christianscience.com/robots.txt
Redirect https://www.christianscience.com:443/robots.txt
Redirect Domain www.christianscience.com
Redirect Base christianscience.com
Domain IPs 13.227.254.125, 13.227.254.39, 13.227.254.78, 13.227.254.93
Redirect IPs 13.227.254.125, 13.227.254.39, 13.227.254.78, 13.227.254.93, 2600:9000:200a:4400:4:23b1:2100:93a1, 2600:9000:200a:5c00:4:23b1:2100:93a1, 2600:9000:200a:600:4:23b1:2100:93a1, 2600:9000:200a:7e00:4:23b1:2100:93a1, 2600:9000:200a:9000:4:23b1:2100:93a1, 2600:9000:200a:a200:4:23b1:2100:93a1, 2600:9000:200a:bc00:4:23b1:2100:93a1, 2600:9000:200a:f400:4:23b1:2100:93a1
Response IP 13.227.254.125
Found Yes
Hash 3d0ca79a5656d770f95ac4a1c93418d03a95c1b4ee7dc8d4a7c1ec98333a2e5b
SimHash f930e42845b0

Groups

*

Rule Path
Disallow /find-us/find-a-christian-science-practitioner
Disallow /find-us/find-a-christian-science-teacher
Disallow /find-us/find-a-christian-science-nurse
Disallow /download-hub-for-christian-science-publications
Disallow /find-us/visit-the-mother-church/visit-the-christian-science-plaza/welcome-hall
Disallow /login
Allow /search$
Disallow /search*
Disallow /lectures/daily-lift/feed
Disallow /*/lectures/daily-lift/feed

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • Ticket: https://allcsps.atlassian.net/browse/CS-513
  • Removing /login from search engines like Google
  • Disable indexing of site search results
  • Removing the Daily Lift feed from the search engines