thinkspain.com
robots.txt
Robots Exclusion Standard data for thinkspain.com
Resource Scan
Scan Details
| Site Domain | thinkspain.com |
| Base Domain | thinkspain.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-11-03T03:19:10+00:00 |
| Next Scan | 2025-01-02T03:19:10+00:00 |
Last Successful Scan
| Scanned | 2024-09-04T01:43:44+00:00 |
| URL | https://thinkspain.com/robots.txt |
| Redirect | https://www.thinkspain.com/robots.txt |
| Redirect Domain | www.thinkspain.com |
| Redirect Base | thinkspain.com |
| Domain IPs | 13.41.20.22, 3.10.48.147 |
| Redirect IPs | 13.41.20.22, 3.10.48.147 |
| Response IP | 3.10.48.147 |
| Found | Yes |
| Hash | cc78f0acc958e0d57c6948cbcdf27f6deb10219407943f73b5ec7f1fc861e92b |
| SimHash | 407080d1451f |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */resume/ |
| Disallow | */user/ |
| Disallow | */auth/ |
| Disallow | */profile/ |
| Disallow | */contact$ |
| Disallow | */contact? |
| Disallow | /change-language$ |
| Disallow | /change-language? |
| Disallow | /change-currency$ |
| Disallow | /change-currency? |
| Disallow | /*?*stateMode=replace* |
| Disallow | /pl/katalog-firm |
| Disallow | /pl/spain-listings |
| Allow | /pl/katalog-firm*/agenci-nieruchomosci |
| Allow | /pl/katalog-firm*/prawnicy-i-adwokaci |
| Disallow | /fr/annuaire-espagne |
| Disallow | /fr/spain-listings |
| Allow | /fr/annuaire-espagne*/agences-immobilieres |
| Allow | /fr/annuaire-espagne*/avocats |
| Disallow | /it/directory-spagna |
| Disallow | /it/spain-listings |
| Allow | /it/directory-spagna*/agenti-immobiliari |
| Allow | /it/directory-spagna*/avvocati-studi-legali |
| Disallow | /nl/bedrijven-directory-spanje |
| Disallow | /nl/spain-listings |
| Allow | /nl/bedrijven-directory-spanje*/onroerendgoedmakelaars |
| Allow | /nl/bedrijven-directory-spanje*/advocaten |
| Disallow | /sv/foeretagskatalogen |
| Disallow | /sv/spain-listings |
| Allow | /sv/foeretagskatalogen*/fastighetsmaklare |
| Allow | /sv/foeretagskatalogen*/advokat-juridiskt-ombud |
| Disallow | /no/bedriftskatalogen |
| Disallow | /no/spain-listings |
| Allow | /no/bedriftskatalogen*/eiendomsmeglere |
| Allow | /no/bedriftskatalogen*/advokater-jurister |
| Disallow | /da/spanien-katalog |
| Disallow | /da/spain-listings |
| Allow | /da/spanien-katalog*/ejendomsmaeglere |
| Allow | /da/spanien-katalog*/advokater-jurister |
| Disallow | /pt/diretorio-empresas-espanha |
| Disallow | /pt/spain-listings |
| Allow | /pt/diretorio-empresas-espanha*/agentes-imobiliarios |
| Allow | /pt/diretorio-empresas-espanha*/advogados-solicitadores |
| Disallow | /fi/yrityshakemisto-espanja |
| Disallow | /fi/spain-listings |
| Allow | /fi/yrityshakemisto-espanja*/kiinteistonvalittaja |
| Allow | /fi/yrityshakemisto-espanja*/asianajajat |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thinkspain.com/sitemap.xml |
| sitemap | https://www.thinkspain.com/article-sitemaps.xml |
| sitemap | https://www.thinkspain.com/where-to-buy-rent-live/sitemaps.xml |
Comments