nexdu.com
robots.txt

Robots Exclusion Standard data for nexdu.com

Resource Scan

Scan Details

Site Domain nexdu.com
Base Domain nexdu.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-07T11:14:55+00:00
Next Scan 2024-12-06T11:14:55+00:00

Last Successful Scan

Scanned2023-05-14T08:25:43+00:00
URL https://nexdu.com/robots.txt
Redirect https://www.nexdu.com/robots.txt
Redirect Domain www.nexdu.com
Redirect Base nexdu.com
Domain IPs 144.202.40.217
Redirect IPs 144.202.40.217
Response IP 144.202.40.217
Found Yes
Hash 05695f94177a479b9c0ce6aa9d75784762807e6c18f28e1a8ccc5b332610db7b
SimHash 885f1d5056e9

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /*/panel/*
Disallow /*/search/*
Disallow /ajax/*
Disallow /*?_escaped_fragment_
Disallow /*?4
Disallow /*?1
Disallow /*?5
Disallow /*?2
Disallow /*?3
Disallow /*?lang
Disallow /*?query
Disallow /*?place
Disallow /*?q
Disallow /*?p
Disallow /*?fb_comment_id
Disallow /arte-y-entretenimiento-list-1
Disallow /automoviles-list-2
Disallow /servicios-profesionales-y-de-negocios-list-3
Disallow /iglesias-y-lugares-de-culto-list-4
Disallow /contratistas-y-construccion-list-5
Disallow /educacion-list-6
Disallow /alimentos-y-cenas-list-7
Disallow /gobierno-list-8
Disallow /industria-list-9
Disallow /salud-y-medicina-list-10
Disallow /compras-list-11
Disallow /viajes-y-recreacion-list-12
Disallow /servicios-para-mascotas-y-suministros-list-13
Disallow /servicios-personales-list-14
Disallow /*/view-all-cat
Disallow /*-page-2
Disallow /*-page-3
Disallow /*-page-4
Disallow /*-page-5
Disallow /*-page-6
Disallow /*-page-7
Disallow /*/q/*/p-
Disallow /*/q/*/page-
Disallow */quality?_
Disallow /*/empresa/*/reviews
Disallow /*/empresa/*/opiniones
Disallow /*/empresa/*/map
Disallow /*/empresa/*/gallery

*

Rule Path
Disallow /cdn-cgi/

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.