rgstrong-genes.com
robots.txt
Robots Exclusion Standard data for rgstrong-genes.com
Resource Scan
Scan Details
| Site Domain | rgstrong-genes.com |
| Base Domain | rgstrong-genes.com |
| Scan Status | Ok |
| Last Scan | 2025-05-12T06:04:07+00:00 |
| Next Scan | 2025-05-19T06:04:07+00:00 |
Last Scan
| Scanned | 2025-05-12T06:04:07+00:00 |
| URL | https://rgstrong-genes.com/robots.txt |
| Domain IPs | 192.252.156.17 |
| Response IP | 192.252.156.17 |
| Found | Yes |
| Hash | cd797e75d95be758cd9c5682744cb24cfd3dd2361dfc259027af0fe6af9a910f |
| SimHash | 90120ca0c80d |
Groups
mediapartners-google*
twiceler
gigabot
aspseek
asterias
baiduspider
bravobrian
dloader(naverrobot)
dumbot
egotobot
gaisbot
generic
grub-client
http://www.almaden.ibm.com/cs/crawler
infonavirobot
jyxobot
larbin
msiecrawler
msnbot
naverrobot
nexabot
npbot
obot
owr_crawler
panscient
phpdig
psbot
puf
quepasacreep
rabaz
reaper
rpt-httpclient
scoutabout
semanticdiscovery
steeler
teleport pro
turnitinbot
tutorgig
unitymedia
vsecrawler
wget
semrushbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /bot-trap |
| Disallow | /lazarusgb/ |
| Disallow | /admin |
| Disallow | /lazarusgb |
| Disallow | /site_backups |
| Disallow | /include |
| Disallow | /cgi-bin |
| Disallow | /Images |
| Disallow | /gedcom_uploads |
| Disallow | /photos |
| Disallow | /headstones |
| Disallow | /histories |
| Disallow | /Sounds |
| Disallow | /calendar.php |
| Disallow | /pedigree.php |
| Disallow | /desctracker.php |
| Disallow | /descend.php |
| Disallow | /relateform.php |
| Disallow | /timeline.php |
| Disallow | /suggest.php |
| Disallow | /familygroup.php |
| Disallow | /showsource.php |
| Disallow | /showtree.php |
| Disallow | /searchform.php |
| Disallow | /login.php |
| Disallow | /surnames.php |
| Disallow | /relationship.php |
| Disallow | /browsephotos.php |
| Disallow | /browsedocs.php |
| Disallow | /cemeteries.php |
| Disallow | /browsenotes.php |
| Disallow | /browsesources.php |
| Disallow | /extrastree.php |
| Disallow | /places.php |
| Disallow | /placesearch.php |
| Disallow | /anniversaries.php |
| Disallow | /whatsnew.php |
| Disallow | /reports.php |
| Disallow | /browsetrees.php |
| Disallow | /familygroup.php |
| Disallow | /pedigree.php |
| Disallow | /descend.php |
| Disallow | /relateform.php |
| Disallow | /timeline.php |
| Disallow | /search.php |
| Disallow | /suggest.php |
| Disallow | /showphoto.php |
| Disallow | /ahnentafel.php |
| Disallow | /extrastree.php |
| Disallow | /showrepo.php |
| Disallow | /pedigreetext.php |
| Disallow | /ultraped.php |
| Disallow | /guestbook.php |
| Disallow | /familychart.php |
Comments