xml.thinkspain.com
robots.txt
Robots Exclusion Standard data for xml.thinkspain.com
Resource Scan
Scan Details
Site Domain | xml.thinkspain.com |
Base Domain | thinkspain.com |
Scan Status | Ok |
Last Scan | 2024-05-26T01:20:36+00:00 |
Next Scan | 2024-06-25T01:20:36+00:00 |
Last Scan
Scanned | 2024-05-26T01:20:36+00:00 |
URL | https://xml.thinkspain.com/robots.txt |
Redirect | https://www.thinkspain.com:443/robots.txt |
Redirect Domain | www.thinkspain.com |
Redirect Base | thinkspain.com |
Domain IPs | 18.155.192.20, 18.155.192.24, 18.155.192.25, 18.155.192.50 |
Redirect IPs | 13.40.21.143, 18.169.3.166 |
Response IP | 18.169.3.166 |
Found | Yes |
Hash | ad7a339fdc4305c67aec1544d0f11ca9c4a3165e9507624c34006278725099d2 |
SimHash | 407080d14d1f |
Groups
*
Rule | Path |
---|---|
Disallow | */resume/ |
Disallow | */user/ |
Disallow | */auth/ |
Disallow | */profile/ |
Disallow | */contact$ |
Disallow | */contact? |
Disallow | /change-language$ |
Disallow | /change-language? |
Disallow | /change-currency$ |
Disallow | /change-currency? |
Disallow | /*?*stateMode=replace* |
Disallow | /pl/katalog-firm |
Disallow | /pl/spain-listings |
Allow | /pl/katalog-firm*/agenci-nieruchomosci |
Allow | /pl/katalog-firm*/prawnicy-i-adwokaci |
Disallow | /fr/annuaire-espagne |
Disallow | /fr/spain-listings |
Allow | /fr/annuaire-espagne*/agences-immobilieres |
Allow | /fr/annuaire-espagne*/avocats |
Disallow | /it/directory-spagna |
Disallow | /it/spain-listings |
Allow | /it/directory-spagna*/agenti-immobiliari |
Allow | /it/directory-spagna*/avvocati-studi-legali |
Disallow | /nl/bedrijven-directory-spanje |
Disallow | /nl/spain-listings |
Allow | /nl/bedrijven-directory-spanje*/onroerendgoedmakelaars |
Allow | /nl/bedrijven-directory-spanje*/advocaten |
Disallow | /sv/foeretagskatalogen |
Disallow | /sv/spain-listings |
Allow | /sv/foeretagskatalogen*/fastighetsmaklare |
Allow | /sv/foeretagskatalogen*/advokat-juridiskt-ombud |
Disallow | /no/bedriftskatalogen |
Disallow | /no/spain-listings |
Allow | /no/bedriftskatalogen*/eiendomsmeglere |
Allow | /no/bedriftskatalogen*/advokater-jurister |
Disallow | /da/spanien-katalog |
Disallow | /da/spain-listings |
Allow | /da/spanien-katalog*/ejendomsmaeglere |
Allow | /da/spanien-katalog*/advokater-jurister |
Disallow | /pt/diretorio-empresas-espanha |
Disallow | /pt/spain-listings |
Allow | /pt/diretorio-empresas-espanha*/agentes-imobiliarios |
Allow | /pt/diretorio-empresas-espanha*/advogados-solicitadores |
Disallow | /fi/yrityshakemisto-espanja |
Disallow | /fi/spain-listings |
Allow | /fi/yrityshakemisto-espanja*/kiinteistonvalittaja |
Allow | /fi/yrityshakemisto-espanja*/asianajajat |
Other Records
Field | Value |
---|---|
sitemap | https://www.thinkspain.com/sitemap.xml |
sitemap | https://www.thinkspain.com/article-sitemaps.xml |
Comments