softlay.net
robots.txt

Robots Exclusion Standard data for softlay.net

Resource Scan

Scan Details

Site Domain softlay.net
Base Domain softlay.net
Scan Status Ok
Last Scan2024-11-13T21:58:12+00:00
Next Scan 2024-11-20T21:58:12+00:00

Last Scan

Scanned2024-11-13T21:58:12+00:00
URL https://softlay.net/robots.txt
Domain IPs 146.190.48.50
Response IP 146.190.48.50
Found Yes
Hash 4095338a93d633181ce216e67b09e7610a0108c1e47ca2cce3a9ec308df2a794
SimHash 72084f4042a0

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /comments/feed/
Disallow /trackback/
Disallow /index.php
Disallow /xmlrpc.php
Disallow /wp-content/plugins/

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

sakbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

serptimizerbot

Rule Path
Disallow /

roistat bot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

umbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

woobot

Rule Path
Disallow /

hubspot crawler

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

domcop bot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

verticalleap-backlinkchecker

Rule Path
Disallow /

verticalleap-backlinkcheckerbot

Rule Path
Disallow /

seolizer

Rule Path
Disallow /

miralinks robot

Rule Path
Disallow /

pr-cy.ru

Rule Path
Disallow /

seodiver

Rule Path
Disallow /