glocalabel.com
robots.txt
Robots Exclusion Standard data for glocalabel.com
Resource Scan
Scan Details
Site Domain | glocalabel.com |
Base Domain | glocalabel.com |
Scan Status | Ok |
Last Scan | 2024-09-21T19:54:01+00:00 |
Next Scan | 2024-09-28T19:54:01+00:00 |
Last Scan
Scanned | 2024-09-21T19:54:01+00:00 |
URL | https://glocalabel.com/robots.txt |
Domain IPs | 104.21.32.252, 172.67.139.12, 2606:4700:3031::ac43:8b0c, 2606:4700:3036::6815:20fc |
Response IP | 172.67.139.12 |
Found | Yes |
Hash | c05688d66c334825c976302c9afa2e19ddf8d8f0bce8bb939f54aaf9d138882b |
SimHash | 5d43ad0cee7d |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /api/ |
Disallow | /banners/ |
Disallow | /associate/ |
Disallow | /cabinet/ |
Disallow | /click_fashion/ |
Disallow | /click_recomended_network/ |
Disallow | /click/ |
Disallow | /complete/ |
Disallow | /core/ |
Disallow | /disconnect/ |
Disallow | /filter/ |
Disallow | /forgot-password/ |
Disallow | /banners/get_banner/ |
Disallow | /login/ |
Disallow | /logout/ |
Disallow | /newsletter/ |
Disallow | /personal/ |
Disallow | /search/ |
Disallow | /select2/ |
Disallow | /send-activity/ |
Disallow | /socialauth/complete/ |
Disallow | /tinymce/ |
Disallow | /user-activity/ |
Disallow | /go/ |
Disallow | /cart/ |
Disallow | /order/ |
Disallow | /other-cities-network/ |
Disallow | /likes/ajax/like/ |
Disallow | *thing*page |
Disallow | /brands/ |
Disallow | /network/city/*/mall/ |
Disallow | /catalog/city/*/type/ |
Disallow | /allbrands/ |
Disallow | /word/ |
Disallow | /network/*page |
Disallow | /word/*page |
Disallow | */target/ |
Disallow | *sm_byp |
Disallow | *fb_comment_id |
Disallow | *fb_xd_fragment |
Disallow | *cid%3D |
Disallow | *android-app |
Disallow | *com.google.android |
Disallow | *fb_ |
Disallow | *search%3D |
Disallow | *searchid%3D |
Disallow | *sa%3D |
Disallow | *cx%3D |
Disallow | *sqi%3D |
Disallow | *search_text%3D |
Disallow | *price%3D |
Disallow | *wtf_ |
yandex
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /api/ |
Disallow | /banners/ |
Disallow | /associate/ |
Disallow | /cabinet/ |
Disallow | /click_fashion/ |
Disallow | /click_recomended_network/ |
Disallow | /click/ |
Disallow | /complete/ |
Disallow | /core/ |
Disallow | /disconnect/ |
Disallow | /filter/ |
Disallow | /forgot-password/ |
Disallow | /banners/get_banner/ |
Disallow | /login/ |
Disallow | /logout/ |
Disallow | /newsletter/ |
Disallow | /personal/ |
Disallow | /search/ |
Disallow | /select2/ |
Disallow | /send-activity/ |
Disallow | /socialauth/complete/ |
Disallow | /tinymce/ |
Disallow | /user-activity/ |
Disallow | /go/ |
Disallow | /cart/ |
Disallow | /order/ |
Disallow | /other-cities-network/ |
Disallow | /likes/ajax/like/ |
Disallow | *thing*page |
Disallow | /brands/ |
Disallow | /network/city/*/mall/ |
Disallow | /catalog/city/*/type/ |
Disallow | /allbrands/ |
Disallow | /word/ |
Disallow | /network/*page |
Disallow | /word/*page |
Disallow | */target/ |
Disallow | *fb_comment_id |
Disallow | *sm_byp |
Disallow | *fb_xd_fragment |
Disallow | */amp/ |
Disallow | *cid%3D |
Disallow | *android-app |
Disallow | *com.google.android |
Disallow | *fb_ |
Disallow | *search%3D |
Disallow | *searchid%3D |
Disallow | *sa%3D |
Disallow | *cx%3D |
Disallow | *sqi%3D |
Disallow | *search_text%3D |
Disallow | *price%3D |
Disallow | *wtf_ |
Warnings
- `host` is not a known field.
Comments