solarweb.net
robots.txt

Robots Exclusion Standard data for solarweb.net

Resource Scan

Scan Details

Site Domain solarweb.net
Base Domain solarweb.net
Scan Status Ok
Last Scan2024-11-15T23:05:23+00:00
Next Scan 2024-11-22T23:05:23+00:00

Last Scan

Scanned2024-11-15T23:05:23+00:00
URL https://solarweb.net/robots.txt
Redirect https://www.solarweb.net/robots.txt
Redirect Domain www.solarweb.net
Redirect Base solarweb.net
Domain IPs 104.21.2.71, 172.67.128.223, 2606:4700:3034::ac43:80df, 2606:4700:3035::6815:247
Redirect IPs 104.21.2.71, 172.67.128.223, 2606:4700:3034::ac43:80df, 2606:4700:3035::6815:247
Response IP 172.67.128.223
Found Yes
Hash f9a4408ce0761b3f4a8c0cb125419370c37b5269afd21fe6fc6c664b024d41bc
SimHash ee5f94e4455d

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /agregador/
Disallow /banners/
Disallow /blog-images/
Disallow /cache/
Disallow /cgi-bin/
Disallow /compraventa/
Disallow /cutenoticias/
Disallow /envio/
Disallow /es/
Disallow /fotografias/
Disallow /phpld33/
Disallow /plantillas/
Disallow /consejos.txt
Disallow /forosolar/adminsol/
Disallow /forosolar/clientscript/
Disallow /forosolar/includes/
Disallow /forosolar/install/
Disallow /forosolar/modsol/
Disallow /forosolar/manual-moderacion/
Disallow /forosolar/archive/
Disallow /forosolar/members/
Disallow /forosolar/usuarios/
Disallow /forosolar/presentaciones/
Disallow /forosolar/bricolaje-hazlo-tu-mismo/
Disallow /forosolar/energia-eolica/
Disallow /forosolar/foro-especial-retroactividad-fotovoltaica/
Disallow /forosolar/ajax.php
Disallow /forosolar/attachment.php
Disallow /forosolar/announcement.php
Disallow /forosolar/calendar.php
Disallow /forosolar/cron.php
Disallow /forosolar/editpost.php
Disallow /forosolar/global.php
Disallow /forosolar/faq.php
Disallow /forosolar/image.php
Disallow /forosolar/inlinemod.php
Disallow /forosolar/joinrequests.php
Disallow /forosolar/login.php
Disallow /forosolar/member.php
Disallow /forosolar/misc.php
Disallow /forosolar/moderator.php
Disallow /forosolar/newattachment.php
Disallow /forosolar/newreply.php
Disallow /forosolar/newthread.php
Disallow /forosolar/online.php
Disallow /forosolar/payments.php
Disallow /forosolar/postings.php
Disallow /forosolar/printthread.php
Disallow /forosolar/private.php
Disallow /forosolar/profile.php
Disallow /forosolar/register.php
Disallow /forosolar/reputation.php
Disallow /forosolar/report.php
Disallow /forosolar/search.php
Disallow /forosolar/sendmessage.php
Disallow /forosolar/sendmessage.php?do=
Disallow /forosolar/showgroups.php
Disallow /forosolar/showpost.php
Disallow /forosolar/subscription.php
Disallow /forosolar/subscriptions.php
Disallow /forosolar/threadrate.php
Disallow /forosolar/usercp.php
Disallow /forosolar/vbseocp.php
Disallow /forosolar/aspectos-economicos-legales-administrativos/791-windguru-welsungo-simosol-sungoku-qu-opinais-sos.html
Disallow /forosolar/members/windguru.html
Disallow /forosolar/solar-termica/21109-gran-duda-novasol-energia-solar*
Disallow /forosolar/solar-termica/20778-novasol-no-fabricante-ser-honesto-favor*
Disallow /forosolar/solar-termica/32972-presupuesto-i-d-energia-sevilla*
Disallow /forosolar/off-topic/6632-unisol-grupo-prosolar*

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.solarweb.net/directorio/sitemap.xml
sitemap https://www.solarweb.net/sitemap.xml
sitemap https://www.solarweb.net/forosolar/sitemap_index.xml.gz