wikitree.com
robots.txt
Robots Exclusion Standard data for wikitree.com
Resource Scan
Scan Details
| Site Domain | wikitree.com |
| Base Domain | wikitree.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T13:40:45+00:00 |
| Next Scan | 2024-09-27T13:40:45+00:00 |
Last Scan
| Scanned | 2024-09-20T13:40:45+00:00 |
| URL | https://wikitree.com/robots.txt |
| Redirect | https://www.wikitree.com:443/robots.txt |
| Redirect Domain | www.wikitree.com |
| Redirect Base | wikitree.com |
| Domain IPs | 34.198.180.202, 52.54.166.150 |
| Redirect IPs | 34.198.180.202, 52.54.166.150 |
| Response IP | 34.198.180.202 |
| Found | Yes |
| Hash | 3b26b7e4ee28c589fc1a582fa97c827245793d8d599c4707a627624b3c2322c7 |
| SimHash | ee403b5dced1 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 4 |
*
| Rule | Path |
|---|---|
| Disallow | /treewidget/ |
| Disallow | /contact/ |
| Disallow | /index.php?title=Special%3ABadges |
| Disallow | /index.php?title=Special%3ABrowseMatches |
| Disallow | /wiki/Special%3ABrowseMatches |
| Disallow | /index.php?title=Special%3ABrowsePhotos |
| Disallow | /index.php?title=Special%3AConnection |
| Disallow | /index.php?title=Special%3AContributions |
| Disallow | /index.php?title=Special%3ADNATests |
| Disallow | /index.php?title=Special%3AEcards |
| Disallow | /index.php?title=Special%3AFamilyList |
| Disallow | /wiki/Special%3AFamilyList |
| Disallow | /index.php?title=Special%3AMergePerson |
| Disallow | /index.php?title=Special%3AMergeSpace |
| Disallow | /index.php?title=Special%3ANetworkFeed |
| Disallow | /index.php?title=Special%3ANewImages |
| Disallow | /wiki/Special%3ANewImages |
| Disallow | /index.php?title=Special%3APrivateMessage |
| Disallow | /index.php?title=Special%3ARelationship |
| Disallow | /index.php?title=Special%3ASurnameContributions |
| Disallow | /index.php?title=Special%3AThanks |
| Disallow | /index.php?title=Special%3ATrustedList |
| Disallow | /index.php?title=Special%3AUploadGedcom |
| Disallow | /index.php?title=Special%3AUploadPhoto* |
| Disallow | /index.php?title=Special%3AWatchedList |
| Disallow | /wiki/Special%3AWatchedList |
| Disallow | /index.php?title=Special%3AWhatlinkshere* |
| Disallow | /index.php?title=*&diff=* |
| Disallow | /index.php?title=*&action=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wikitree.com/sitemaps/sitemap_profile_index.xml.gz |
| sitemap | https://www.wikitree.com/sitemaps/sitemap_surname_index.xml.gz |
| sitemap | https://www.wikitree.com/sitemaps/sitemap-help.xml.gz |
| sitemap | https://www.wikitree.com/sitemaps/sitemap-space.xml.gz |
| sitemap | https://www.wikitree.com/sitemaps/sitemap-projects.xml.gz |
| sitemap | https://www.wikitree.com/sitemaps/sitemap-categories.xml.gz |
| sitemap | https://www.wikitree.com/g2g/sitemap.xml |