mirajerez.com
robots.txt

Robots Exclusion Standard data for mirajerez.com

Resource Scan

Scan Details

Site Domain mirajerez.com
Base Domain mirajerez.com
Scan Status Ok
Last Scan2024-05-15T22:45:12+00:00
Next Scan 2024-05-22T22:45:12+00:00

Last Scan

Scanned2024-05-15T22:45:12+00:00
URL https://mirajerez.com/robots.txt
Redirect https://www.elmira.es/robots.txt
Redirect Domain www.elmira.es
Redirect Base elmira.es
Domain IPs 104.21.79.220, 172.67.171.144, 2606:4700:3031::6815:4fdc, 2606:4700:3036::ac43:ab90
Redirect IPs 104.26.0.31, 104.26.1.31, 172.67.75.107, 2606:4700:20::681a:11f, 2606:4700:20::681a:1f, 2606:4700:20::ac43:4b6b
Response IP 172.67.75.107
Found Yes
Hash ce45a6cf7904c46ae57017ff84786ae5a792c1546a71ebfc17dcaea13f77dc1e
SimHash 90105bc2ceb7

Groups

*

Rule Path
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Disallow /api
Disallow /admin
Disallow /search/
Disallow /ads/
Disallow /comments/
Disallow /thelook/
Allow /ads.txt
Allow /tags/economia
Allow /tags/noticias-interesantes
Allow /tags/andalucia
Allow /tags/jerez

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.elmira.es/deportes/sitemap.news.xml
sitemap https://www.elmira.es/sitemap.news.xml
sitemap https://www.elmira.es/sitemap.news.xml.gz
sitemap https://www.elmira.es/sitemap.xml

Comments

  • TEMAS
  • Agentes nocivos conocidos