malagaexiste.es
robots.txt

Robots Exclusion Standard data for malagaexiste.es

Resource Scan

Scan Details

Site Domain malagaexiste.es
Base Domain malagaexiste.es
Scan Status Ok
Last Scan2024-09-26T15:52:36+00:00
Next Scan 2024-10-03T15:52:36+00:00

Last Scan

Scanned2024-09-26T15:52:36+00:00
URL https://malagaexiste.es/robots.txt
Redirect https://www.malagaexiste.es/robots.txt
Redirect Domain www.malagaexiste.es
Redirect Base malagaexiste.es
Domain IPs 54.37.94.165
Redirect IPs 54.37.94.165
Response IP 54.37.94.165
Found Yes
Hash 2379f439f35229f67e205d5dca16968211a7d7d7527896fb83f8ceba3cd0a96e
SimHash 4141c915c791

Groups

*

Rule Path
Disallow /cgi-bin/

mediapartners-google*

Rule Path
Allow /

mediapartners

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.valenciaexiste.es/sitemap.xml
sitemap https://www.valenciaexiste.es/sitemap2.xml
sitemap https://www.valenciaexiste.es/sitemap3.xml