Log In Sign Up

shrijisolutions.com
robots.txt

Robots Exclusion Standard data for shrijisolutions.com

Resource Scan

Scan Details

Site Domain shrijisolutions.com
Base Domain shrijisolutions.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-16T23:53:44+00:00
Next Scan 2024-10-14T23:53:44+00:00

Last Successful Scan

Scanned2024-02-25T23:36:09+00:00
URL https://shrijisolutions.com/robots.txt
Redirect https://www.shrijisolutions.com/robots.txt
Redirect Domain www.shrijisolutions.com
Redirect Base shrijisolutions.com
Domain IPs 13.233.12.221
Redirect IPs 13.233.12.221
Response IP 13.233.12.221
Found Yes
Hash 7817d2ddce55ae6f559db893b63cef6ad45474311cdced81d1512d6f715f46d2
SimHash fa16c7796600

Groups

alittle client

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

anthill

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

domains project

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

fuzz

Rule Path
Disallow /

httrack

Rule Path
Disallow /

kinza

Rule Path
Disallow /

lightspeedsystems

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

masscan

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

micromessenger

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

mojeek

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /

panscient

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

screaming

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

winhttrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dataforseo.com

Rule Path
Disallow /

domainsproject.org

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

seostar

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

ubermetrics-technologies.com

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

webprosbot

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /

ahc/2.1

Rule Path
Disallow /

okhttp/4.9.3

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

go-http-client/2.0

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

android 7.0; sm-g892a bulid/nrd90m

Rule Path
Disallow /

scaninfo@paloaltonetworks.com

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

curl/7.54.0

Rule Path
Disallow /

zhanzhang.toutiao.com

Rule Path
Disallow /

who.is bot

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

phxbot

Rule Path
Disallow /

bytedance.com

Rule Path
Disallow /

linkfluence.com

Rule Path
Disallow /

postmanruntime

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

node/simplecrawler

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

df bot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

bitdiscovery-suggestions

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nexgate ruby client

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

dnbcrawler-analytics

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

facebookscraper

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

python-httpx/0.13.3

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

test-bot

Rule Path
Disallow /

https://github.com/sindresorhus/got

Rule Path
Disallow /

nmap scripting

Rule Path
Disallow /

webgains-bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

minefield

Rule Path
Disallow /

android 7.0; sm-g892a build/nrd90m

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

pycurl

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

https://github.com/gocolly/colly

Rule Path
Disallow /

chrome privacy preserving prefetch proxy

Rule Path
Disallow /

python

Rule Path
Disallow /

superbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

mozilla/5.0 (x11; fedora; linux x86_64; rv:94.0) gecko/20100101 firefox/95.0

Rule Path
Disallow /

kakaotalk-scrap

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.shrijisolutions.com/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top