hobbyoutlet.ru
robots.txt
Robots Exclusion Standard data for hobbyoutlet.ru
Resource Scan
Scan Details
Site Domain | hobbyoutlet.ru |
Base Domain | hobbyoutlet.ru |
Scan Status | Ok |
Last Scan | 2024-10-24T19:52:28+00:00 |
Next Scan | 2024-11-23T19:52:28+00:00 |
Last Scan
Scanned | 2024-10-24T19:52:28+00:00 |
URL | https://hobbyoutlet.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:8:7ef, 2a00:15f8:a000:5:1:12:8:7ef, 2a00:15f8:a000:5:1:13:8:7ef, 2a00:15f8:a000:5:1:14:8:7ef, 90.156.201.28, 90.156.201.36, 90.156.201.37, 90.156.201.80 |
Response IP | 90.156.201.28 |
Found | Yes |
Hash | f44d4c80c2f2ca9c08083b871ce77c92eefad957fca6c2d9751556010f76d967 |
SimHash | 60e97213997b |
Groups
*
Rule | Path |
---|---|
Allow | /hobbyoutlet.ru |
Disallow | *webasyst/ |
Disallow | /checkout/ |
Disallow | /my/ |
Disallow | /search/ |
Disallow | /tag/ |
Disallow | *sort%3D* |
Disallow | /signup/ |
Disallow | /login/ |
Disallow | /forgotpassword/ |
Disallow | /webasyst/ |
Disallow | */blog/ |
Disallow | /?link=* |
Disallow | /compare/ |
Disallow | /cart/ |
Disallow | /hobby-old/ |
Disallow | /photos/ |
Disallow | */reviews/ |
Disallow | */test* |
Disallow | *cml1c/ |
Disallow | */vk/ |
Disallow | */xml/ |
Disallow | */yml/ |
Disallow | */turbo/ |
Disallow | */logs/ |
Disallow | *multiform/ |
Disallow | *.html |
Disallow | *.php |
Disallow | |
Disallow | *vebinar14 |
Disallow | *search |
Disallow | *mailer/ |
Disallow | *login/ |
Disallow | *signup/ |
Disallow | *forgotpassword/ |
Disallow | *order/ |
Disallow | */cart/ |
Disallow | *onestep/ |
Disallow | *checkout/ |
Disallow | */my/ |
Disallow | *?page=* |
Disallow | *tel%3A |
Disallow | *skype%3A |
Disallow | *mailto%3A |
Disallow | *tg%3A |
Disallow | *viber%3A |
Disallow | *undefined |
Disallow | *compare/ |
Disallow | *? |
Disallow | */author/ |
Disallow | */2015/ |
Disallow | */2016/ |
Disallow | */2017/ |
Disallow | */2018/ |
Disallow | */2019/ |
Disallow | */2020/ |
Disallow | */2021/ |
Disallow | */2022/ |
Disallow | */2023/ |
Disallow | */2024/ |
Disallow | */2025/ |
Disallow | */2026/ |
Disallow | */2027/ |
Disallow | */2028/ |
Disallow | */2029/ |
Disallow | */2030/ |
Disallow | */2031/ |
Disallow | */2032/ |
Disallow | */2033/ |
Disallow | */2034/ |
Disallow | */2035/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://hobbyoutlet.ru/sitemap.xml |
Comments