en.qwertynetworks.com
robots.txt
Robots Exclusion Standard data for en.qwertynetworks.com
Resource Scan
Scan Details
Site Domain | en.qwertynetworks.com |
Base Domain | qwertynetworks.com |
Scan Status | Ok |
Last Scan | 2025-03-11T04:25:22+00:00 |
Next Scan | 2025-03-25T04:25:22+00:00 |
Last Scan
Scanned | 2025-03-11T04:25:22+00:00 |
URL | https://en.qwertynetworks.com/robots.txt |
Domain IPs | 104.21.75.48, 172.67.213.196, 2606:4700:3030::ac43:d5c4, 2606:4700:3036::6815:4b30 |
Response IP | 172.67.213.196 |
Found | Yes |
Hash | 79d3c273c633cc207bb1ee645cd54291f09ac359c0f0dda95234cb75bdce3fb1 |
SimHash | 401604626733 |
Groups
yandex
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Disallow | */amp* |
Disallow | */ar/* |
Disallow | */af/* |
Disallow | */da/* |
Disallow | */de/* |
Disallow | */et/* |
Disallow | */es/* |
Disallow | */fa/* |
Disallow | */fi/* |
Disallow | */fr/* |
Disallow | */he/* |
Disallow | */hi/* |
Disallow | */hr/* |
Disallow | */hu/* |
Disallow | */hy/* |
Disallow | */id/* |
Disallow | */it/* |
Disallow | */lv/* |
Disallow | */lt/* |
Disallow | */ja/* |
Disallow | */ko/* |
Disallow | */nl/* |
Disallow | */no/* |
Disallow | */pl/* |
Disallow | */pt/* |
Disallow | */ro/* |
Disallow | */th/* |
Disallow | */tr/* |
Disallow | */uk/* |
Disallow | */vi/* |
Disallow | */zh/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
googlebot
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Allow | */amp*?*lng=* |
Allow | */amp?*lng=* |
Disallow | */*?*utm_source= |
Disallow | */*?*utm_medium= |
Disallow | */*?*utm_term= |
Disallow | */*?*utm_campaign= |
Disallow | *?*utm_source= |
Disallow | *?*utm_medium= |
Disallow | *?*utm_term= |
Disallow | *?*utm_campaign= |
Disallow | */?action=* |
Disallow | */*?*donotpromote* |
Disallow | */*?*unloggedid* |
Disallow | */*?*hello-answer* |
Disallow | */*%26time%3D* |
Disallow | */*?it=* |
Disallow | *?membersof* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
slurp
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Other Records
Field | Value |
---|---|
crawl-delay | 8 |
*
Rule | Path |
---|---|
Disallow | */checkauth* |
Disallow | */edit* |
Disallow | */settings/ |
Disallow | */profile/ |
Disallow | */bill/ |
Disallow | */admin/ |
Disallow | */auth* |
Disallow | */stupidlink* |
Disallow | */go/ |
Disallow | */go?* |
Disallow | */oauthfb |
Disallow | */user/ |
Disallow | */pages/create |
Disallow | */date/ |
Disallow | */users/ |
Disallow | */members/ |
Disallow | */search/ |
Disallow | */placead |
Disallow | */projectpricing |
Disallow | */datingad |
Disallow | */adshow |
Disallow | */number-* |
Disallow | */*?*lng=* |
Disallow | *?*lng=* |
Disallow | */*?*utm_ |
Disallow | *?*utm_ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://qwertynetworks.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.