guelman.me
robots.txt
Robots Exclusion Standard data for guelman.me
Resource Scan
Scan Details
| Site Domain | guelman.me |
| Base Domain | guelman.me |
| Scan Status | Ok |
| Last Scan | 2025-11-01T11:20:39+00:00 |
| Next Scan | 2025-11-15T11:20:39+00:00 |
Last Scan
| Scanned | 2025-11-01T11:20:39+00:00 |
| URL | https://guelman.me/robots.txt |
| Domain IPs | 104.21.16.95, 172.67.167.51, 2606:4700:3035::6815:105f, 2606:4700:3037::ac43:a733 |
| Response IP | 172.67.167.51 |
| Found | Yes |
| Hash | 339a490fae20e4b43008e27784920f09655f8b0f71ee29d17c6f323dce5f16ad |
| SimHash | 401604636533 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | */checkauth* |
| Disallow | */edit* |
| Disallow | */settings/ |
| Disallow | */profile/ |
| Disallow | */bill/ |
| Disallow | */admin/ |
| Disallow | */auth* |
| Disallow | */stupidlink* |
| Disallow | */go/ |
| Disallow | */go?* |
| Disallow | */oauthfb |
| Disallow | */user/ |
| Disallow | */pages/create |
| Disallow | */date/ |
| Disallow | */users/ |
| Disallow | */members/ |
| Disallow | */search/ |
| Disallow | */placead |
| Disallow | */projectpricing |
| Disallow | */datingad |
| Disallow | */adshow |
| Disallow | */number-* |
| Disallow | */*?*lng=* |
| Disallow | *?*lng=* |
| Disallow | *?*switchlng=* |
| Disallow | */*?*switchlng=* |
| Disallow | */amp* |
| Disallow | */ar/* |
| Disallow | */af/* |
| Disallow | */da/* |
| Disallow | */de/* |
| Disallow | */et/* |
| Disallow | */es/* |
| Disallow | */fa/* |
| Disallow | */fi/* |
| Disallow | */fr/* |
| Disallow | */he/* |
| Disallow | */hi/* |
| Disallow | */hr/* |
| Disallow | */hu/* |
| Disallow | */hy/* |
| Disallow | */id/* |
| Disallow | */it/* |
| Disallow | */lv/* |
| Disallow | */lt/* |
| Disallow | */ja/* |
| Disallow | */ko/* |
| Disallow | */nl/* |
| Disallow | */no/* |
| Disallow | */pl/* |
| Disallow | */pt/* |
| Disallow | */ro/* |
| Disallow | */th/* |
| Disallow | */tr/* |
| Disallow | */uk/* |
| Disallow | */vi/* |
| Disallow | */zh/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | */checkauth* |
| Disallow | */edit* |
| Disallow | */settings/ |
| Disallow | */profile/ |
| Disallow | */bill/ |
| Disallow | */admin/ |
| Disallow | */auth* |
| Disallow | */stupidlink* |
| Disallow | */go/ |
| Disallow | */go?* |
| Disallow | */oauthfb |
| Disallow | */user/ |
| Disallow | */pages/create |
| Disallow | */date/ |
| Disallow | */users/ |
| Disallow | */members/ |
| Disallow | */search/ |
| Disallow | */placead |
| Disallow | */projectpricing |
| Disallow | */datingad |
| Disallow | */adshow |
| Disallow | */number-* |
| Disallow | */*?*lng=* |
| Disallow | *?*lng=* |
| Disallow | *?*switchlng=* |
| Disallow | */*?*switchlng=* |
| Allow | */amp*?*lng=* |
| Allow | */amp?*lng=* |
| Disallow | */*?*utm_source= |
| Disallow | */*?*utm_medium= |
| Disallow | */*?*utm_term= |
| Disallow | */*?*utm_campaign= |
| Disallow | *?*utm_source= |
| Disallow | *?*utm_medium= |
| Disallow | *?*utm_term= |
| Disallow | *?*utm_campaign= |
| Disallow | */?action=* |
| Disallow | */?switchlng=* |
| Disallow | */*?*donotpromote* |
| Disallow | */*?*unloggedid* |
| Disallow | */*?*hello-answer* |
| Disallow | */*%26time%3D* |
| Disallow | */*?it=* |
| Disallow | *?membersof* |
| Disallow | */*?*fvc=* |
| Disallow | *?*fvc=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
slurp
| Rule | Path |
|---|---|
| Disallow | */checkauth* |
| Disallow | */edit* |
| Disallow | */settings/ |
| Disallow | */profile/ |
| Disallow | */bill/ |
| Disallow | */admin/ |
| Disallow | */auth* |
| Disallow | */stupidlink* |
| Disallow | */go/ |
| Disallow | */go?* |
| Disallow | */oauthfb |
| Disallow | */user/ |
| Disallow | */pages/create |
| Disallow | */date/ |
| Disallow | */users/ |
| Disallow | */members/ |
| Disallow | */search/ |
| Disallow | */placead |
| Disallow | */projectpricing |
| Disallow | */datingad |
| Disallow | */adshow |
| Disallow | */number-* |
| Disallow | */*?*lng=* |
| Disallow | *?*lng=* |
| Disallow | *?*switchlng=* |
| Disallow | */*?*switchlng=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
*
| Rule | Path |
|---|---|
| Disallow | */checkauth* |
| Disallow | */edit* |
| Disallow | */settings/ |
| Disallow | */profile/ |
| Disallow | */bill/ |
| Disallow | */admin/ |
| Disallow | */auth* |
| Disallow | */stupidlink* |
| Disallow | */go/ |
| Disallow | */go?* |
| Disallow | */oauthfb |
| Disallow | */user/ |
| Disallow | */pages/create |
| Disallow | */date/ |
| Disallow | */users/ |
| Disallow | */members/ |
| Disallow | */search/ |
| Disallow | */placead |
| Disallow | */projectpricing |
| Disallow | */datingad |
| Disallow | */adshow |
| Disallow | */number-* |
| Disallow | */*?*lng=* |
| Disallow | *?*lng=* |
| Disallow | *?*switchlng=* |
| Disallow | */*?*switchlng=* |
| Disallow | */*?*utm_ |
| Disallow | *?*utm_ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://guelman.me/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.