qwertynetworks.com
robots.txt

Robots Exclusion Standard data for qwertynetworks.com

Resource Scan

Scan Details

Site Domain qwertynetworks.com
Base Domain qwertynetworks.com
Scan Status Ok
Last Scan2025-03-09T00:28:36+00:00
Next Scan 2025-03-23T00:28:36+00:00

Last Scan

Scanned2025-03-09T00:28:36+00:00
URL https://qwertynetworks.com/robots.txt
Domain IPs 104.21.75.48, 172.67.213.196, 2606:4700:3030::ac43:d5c4, 2606:4700:3036::6815:4b30
Response IP 172.67.213.196
Found Yes
Hash 79d3c273c633cc207bb1ee645cd54291f09ac359c0f0dda95234cb75bdce3fb1
SimHash 401604626733

Groups

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

pimeyes.com crawler

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

olecrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

vedma

Rule Path
Disallow /

riddler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

yandex

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Disallow */amp*
Disallow */ar/*
Disallow */af/*
Disallow */da/*
Disallow */de/*
Disallow */et/*
Disallow */es/*
Disallow */fa/*
Disallow */fi/*
Disallow */fr/*
Disallow */he/*
Disallow */hi/*
Disallow */hr/*
Disallow */hu/*
Disallow */hy/*
Disallow */id/*
Disallow */it/*
Disallow */lv/*
Disallow */lt/*
Disallow */ja/*
Disallow */ko/*
Disallow */nl/*
Disallow */no/*
Disallow */pl/*
Disallow */pt/*
Disallow */ro/*
Disallow */th/*
Disallow */tr/*
Disallow */uk/*
Disallow */vi/*
Disallow */zh/*

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Allow */amp*?*lng=*
Allow */amp?*lng=*
Disallow */*?*utm_source=
Disallow */*?*utm_medium=
Disallow */*?*utm_term=
Disallow */*?*utm_campaign=
Disallow *?*utm_source=
Disallow *?*utm_medium=
Disallow *?*utm_term=
Disallow *?*utm_campaign=
Disallow */?action=*
Disallow */*?*donotpromote*
Disallow */*?*unloggedid*
Disallow */*?*hello-answer*
Disallow */*%26time%3D*
Disallow */*?it=*
Disallow *?membersof*

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*

Other Records

Field Value
crawl-delay 8

*

Rule Path
Disallow */checkauth*
Disallow */edit*
Disallow */settings/
Disallow */profile/
Disallow */bill/
Disallow */admin/
Disallow */auth*
Disallow */stupidlink*
Disallow */go/
Disallow */go?*
Disallow */oauthfb
Disallow */user/
Disallow */pages/create
Disallow */date/
Disallow */users/
Disallow */members/
Disallow */search/
Disallow */placead
Disallow */projectpricing
Disallow */datingad
Disallow */adshow
Disallow */number-*
Disallow */*?*lng=*
Disallow *?*lng=*
Disallow */*?*utm_
Disallow *?*utm_

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://qwertynetworks.com/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.