findmypast.com
robots.txt

Robots Exclusion Standard data for findmypast.com

Resource Scan

Scan Details

Site Domain findmypast.com
Base Domain findmypast.com
Scan Status Ok
Last Scan2024-10-26T10:49:52+00:00
Next Scan 2024-11-25T10:49:52+00:00

Last Scan

Scanned2024-10-26T10:49:52+00:00
URL https://findmypast.com/robots.txt
Redirect https://www.findmypast.com/robots.txt
Redirect Domain www.findmypast.com
Redirect Base findmypast.com
Domain IPs 104.26.2.45, 104.26.3.45, 172.67.75.48
Redirect IPs 104.26.2.45, 104.26.3.45, 172.67.75.48
Response IP 104.26.3.45
Found Yes
Hash cc8a9b2ab7bef477f9e9358925ded0c716a900cbf8bff017da1f61edde3b98b7
SimHash 4e2e1d4487c3

Groups

*

Rule Path
Allow /collections/findmypast
Allow /collections/collection
Disallow */search/*
Disallow /*nextPage%3D*
Disallow /*lastname%3D*
Disallow /*datasetname%3D*
Disallow /*county%3D*
Disallow /*sid%3D*
Disallow /*datasetname%3D*
Disallow /*?id=*
Disallow /*event_location%3D*
Disallow /*%26occupation
Disallow /*date%3D*
Disallow /*date_offsetdate%3D*
Disallow /*?user-origin=*
Disallow /search?tag=*
Disallow */results?*
Disallow *article%3D*
Disallow *stringtohighlight%3D*
Disallow *journey%3D*
Disallow */payment*
Disallow *?isfreetrialrequest=*
Disallow *?promocode=*
Disallow */record?id=gbm*
Disallow *?wptouch_switch*
Disallow */spc/*
Disallow */sign-in?nextpage=*
Disallow /boards
Disallow /canopy
Disallow /maps/*
Disallow /search/results
Disallow /transcript
Disallow /tree
Allow /tree/example-family-tree
Allow /tree/fmp-000000-000000/tree
Disallow /ldna
Disallow /discover
Disallow /discover/

facebookexternalhit

Rule Path
Allow /collections/collection

googlebot

Rule Path
Disallow */search/*
Disallow /*nextPage%3D*
Disallow /*lastname%3D*
Disallow /*datasetname%3D*
Disallow /*county%3D*
Disallow /*sid%3D*
Disallow /*datasetname%3D*
Disallow /*?id=*
Disallow /*event_location%3D*
Disallow /*%26occupation
Disallow /*date%3D*
Disallow /*date_offsetdate%3D*
Disallow */*?user-origin=*
Disallow */search?tag=*
Disallow */results?*
Disallow *article%3D*
Disallow *stringtohighlight%3D*
Disallow *journey%3D*
Disallow */payment*
Disallow *?isfreetrialrequest=*
Disallow *?promocode=*
Disallow */record?id=gbm*
Disallow *?wptouch_switch*
Disallow */spc/*
Disallow */sign-in?nextpage=*
Allow /gift-subscriptions?plan-ids
Disallow /gift-subscriptions?plan-ids*&
Disallow /boards
Disallow /canopy
Disallow /maps/*
Disallow /search/results
Disallow /transcript
Disallow /tree
Allow /tree/example-family-tree
Allow /tree/fmp-000000-000000/tree
Disallow /ldna
Disallow /surname/random
Disallow /discover
Disallow /discover/

bingbot

Rule Path
Disallow */search/*
Disallow /*nextPage%3D*
Disallow /*lastname%3D*
Disallow /*datasetname%3D*
Disallow /*county%3D*
Disallow /*sid%3D*
Disallow /*datasetname%3D*
Disallow /*?id=*
Disallow /*event_location%3D*
Disallow /*%26occupation
Disallow /*date%3D*
Disallow /*date_offsetdate%3D*
Disallow */*?user-origin=*
Disallow */search?tag=*
Disallow */results?*
Disallow *article%3D*
Disallow *stringtohighlight%3D*
Disallow *journey%3D*
Disallow */payment*
Disallow *?isfreetrialrequest=*
Disallow *?promocode=*
Disallow */record?id=gbm*
Disallow *?wptouch_switch*
Disallow */spc/*
Disallow */sign-in?nextpage=*
Disallow /boards
Disallow /canopy
Disallow /maps/*
Disallow /search/results
Disallow /transcript
Disallow /tree
Allow /tree/example-family-tree
Allow /tree/fmp-000000-000000/tree
Disallow /ldna
Disallow /surname/random
Disallow /discover
Disallow /discover/

awariorssbot
awariosmartbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.findmypast.com/sitemap.xml

Comments

  • Help us to impact the way people research social and family history!
  • Check out our vacancies here: https://www.findmypast.com/careers