aupair.com
robots.txt
Robots Exclusion Standard data for aupair.com
Resource Scan
Scan Details
| Site Domain | aupair.com |
| Base Domain | aupair.com |
| Scan Status | Ok |
| Last Scan | 2024-06-04T18:35:37+00:00 |
| Next Scan | 2024-06-18T18:35:37+00:00 |
Last Scan
| Scanned | 2024-06-04T18:35:37+00:00 |
| URL | https://aupair.com/robots.txt |
| Redirect | https://www.aupair.com/robots.txt |
| Redirect Domain | www.aupair.com |
| Redirect Base | aupair.com |
| Domain IPs | 87.230.62.153 |
| Redirect IPs | 87.230.62.153 |
| Response IP | 87.230.62.153 |
| Found | Yes |
| Hash | c6a988042fb40d9784ae405aca2f8abbc94f477a7aa15051ac4076666233b0d8 |
| SimHash | e78c8870cab3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aupair-family-thumbs/ |
| Disallow | /aupair-family-thumbs2/ |
seekportbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /find-aupair/ |
| Disallow | /contact.php |
| Disallow | /help.php |
| Disallow | /error_reports.php |
| Disallow | /price_list.php |
| Disallow | /terms_condition.php |
| Disallow | /index.php?language=es |
| Disallow | /index.php?language=en |
| Disallow | /index.php?language=it |
| Disallow | /index.php?language=pt |
| Disallow | /index.php?language=ru |
| Disallow | /index.php?language=fr |
| Disallow | /find_aupair.php?language= |
| Disallow | /find_aupair.php?page= |
| Disallow | /find_aupair.php?PHPSESSID= |
| Disallow | /find_aupair.php?quick_search=search&home_country=*&gender=2&language=*&PHPSESSID= |
| Disallow | /find_family.php?page= |
| Disallow | /find_family.php?language=* |
| Disallow | /fr/trouver-au-pair/filipino-aupaire-de-la-philippines-cherche-travail-aupaire-france-197536.php |
| Disallow | /es/busca-de-aupair/au-pair-filipino-de-philippines-busca-trabajo-de-au-pair-en-france-197536.php |
| Disallow | /view-member-profile.php* |
| Disallow | /forgot_password.php* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aupair.com/siteMaps/experience.xml |
| sitemap | https://www.aupair.com/siteMaps/blog.xml |
| sitemap | https://www.aupair.com/siteMaps/content.xml |
| sitemap | https://www.aupair.com/siteMaps/aupairProfiles.xml |
| sitemap | https://www.aupair.com/siteMaps/familyProfiles.xml |