mylife.com
robots.txt
Robots Exclusion Standard data for mylife.com
Resource Scan
Scan Details
| Site Domain | mylife.com |
| Base Domain | mylife.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-08-28T05:57:26+00:00 |
| Next Scan | 2024-10-27T05:57:26+00:00 |
Last Successful Scan
| Scanned | 2024-06-30T05:37:03+00:00 |
| URL | http://www.mylife.com/robots.txt |
| Domain IPs | 216.52.223.150 |
| Response IP | 216.52.223.150 |
| Found | Yes |
| Hash | 2081b65bf05bf79e1a719bdb7bcd00cc97f3870cfa27a66b5b8e3a2704573419 |
| SimHash | 2f57d63cd600 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /pub-multisearch.pubview?search=* |
| Disallow | /pub/ |
| Disallow | /showClaimingRegistrationForm.pub |
| Disallow | /showClaimingRegistration.pub |
| Disallow | /search/seo-reg/ |
| Disallow | /json/teaser/wsfy/ |
| Disallow | /search* |
| Allow | /search-*/*$ |
| Disallow | /*bingImage* |
| Disallow | /*bingImage.mediaUrl* |
| Disallow | /*bingimage.mediaurl* |
| Disallow | /null*.jpg |
| Disallow | /people-search-directory/* |
| Disallow | /json/search/people/ |
| Disallow | /site/ |
| Disallow | /trk/* |
| Disallow | /%7BUS_FEMALE_NAME%7D-%7BUS_CENSUS_NAME%7D/* |
| Allow | /phone-*/* |
| Allow | /phone-*-*-* |
| Allow | /json/public/* |
| Allow | /wro/ |
| Allow | /global/ |
| Allow | /*-*/ |
| Allow | /*.xml$ |
| Allow | /*.html$ |
| Allow | /*.pub$ |
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.JPG$ |
| Allow | /*.JPEG$ |
| Allow | /*.PNG$ |
| Allow | /*.png$ |
| Allow | /*.css |
| Allow | /*.js |
| Allow | /*.CSS |
| Allow | /*.JS |
| Allow | /blog* |
| Allow | /privacy |
| Allow | /help |
| Allow | /about-us |
| Allow | /user-agreement |
| Allow | /seostatic/bootstrap* |
| Allow | /seostatic/css* |
| Allow | /seostatic/fonts* |
| Allow | /seostatic/img* |
| Allow | /seostatic/js* |
| Allow | /adzija-markicic |
| Allow | /artjmag |
| Allow | /*.gz$ |
| Allow | /site/login.pubview* |
| Allow | /site/ob/pub_search_bgc_flow16/ps-bgc.pubview$ |
| Allow | /seostatic/wro/search-by-name.* |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Allow | /site/ob/init/ps-bgc.pubview* |
| Allow | /site/wsfy.view$ |
| Allow | /*gclid* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mylife.com/sitemap-crawl-index-202208.xml |
| sitemap | https://www.mylife.com/sitemap-crawl-childXXXX-202208.txt |
| sitemap | https://www.mylife.com/sitemap-crawl-samenameprofiles-index.xml |
| sitemap | https://www.mylife.com/static.xml |