masterwebs.ru
robots.txt
Robots Exclusion Standard data for masterwebs.ru
Resource Scan
Scan Details
| Site Domain | masterwebs.ru |
| Base Domain | masterwebs.ru |
| Scan Status | Ok |
| Last Scan | 2025-04-04T00:53:04+00:00 |
| Next Scan | 2025-05-04T00:53:04+00:00 |
Last Scan
| Scanned | 2025-04-04T00:53:04+00:00 |
| URL | https://masterwebs.ru/robots.txt |
| Domain IPs | 104.21.69.22, 172.67.202.213, 2606:4700:3030::ac43:cad5, 2606:4700:3033::6815:4516 |
| Response IP | 104.21.69.22 |
| Found | Yes |
| Hash | fc498c1ce62e52f5941d65c2855c40c03f9dd01b8cc73b94778db372bf3c1923 |
| SimHash | 702d189db2bb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*lofiversion |
| Disallow | /*setlanguage |
| Disallow | /*?s |
| Disallow | /*ptopic |
| Disallow | /*act%3D |
| Disallow | /*pid%3D |
| Disallow | /*?start= |
| Disallow | /*CP%26CODE |
| Disallow | /*aboutme%26mid |
| Disallow | /*view%3Dgetnewpost$ |
| Disallow | /*view%3Dgetlastpost$ |
| Disallow | /*view%3Dold$ |
| Disallow | /*view%3Dnew$ |
| Disallow | /*view%3Dgetfirst$ |
| Disallow | /*view%3Dgetprevious$ |
| Disallow | /*view%3Dgetnext$ |
| Disallow | /*view%3Dgetlast$ |
| Disallow | /*mode%3Dlinear |
| Disallow | /*mode%3Dthreaded |
| Disallow | /*mode%3Dlinearplus |
| Disallow | /*%26p%3D |
| Disallow | /*?p= |
| Disallow | /*%26gopid%3D |
| Disallow | /*?gopid= |
| Disallow | /*%26hl%3D |
| Disallow | /*?hl= |
| Disallow | /*%26cal_id |
| Disallow | /*name%3DInfo |
| Disallow | /admin/ |
| Disallow | /converge_local/ |
| Disallow | /hooks/ |
| Disallow | /ips_kernel/ |
| Disallow | /public/style_captcha/ |
| Disallow | /index.php?app=core&module=task |
| Disallow | /index.php?app=core&module=usercp&tab=forums&area=forumsubs |
| Disallow | /index.php?app=core&module=usercp&tab=forums&area=watch&watch=topic |
| Disallow | /index.php?app=forums&module=extras§ion=forward |
| Disallow | /index.php?&unlock |
| Disallow | /*app%3Dcore%26module%3Dusercp |
| Disallow | /*app%3Dcore%26amp%3Bmodule%3Dusercp |
| Disallow | /*%26pid%3D |
| Disallow | /*%26start%3D |
| Disallow | /*view__getnewpost$ |
| Disallow | /*view__getlastpost$ |
| Disallow | /*view__old$ |
| Disallow | /*view__new$ |
| Disallow | /*view__getfirst$ |
| Disallow | /*view__getprevious$ |
| Disallow | /*view__getnext$ |
| Disallow | /*view__getlast$ |
| Disallow | /*%26view%3Dgetnewpost$ |
| Disallow | /*%26s%3D |
| Disallow | /index.php?app=forums&module=extras§ion=rating |
| Disallow | /*module%3Dsearch |
| Disallow | /*module%3Dpost |
| Disallow | /*user_activity |
| Disallow | /*NewSkin |
| Disallow | /*module%3Dlist |
| Disallow | /*section%3Dstats |
| Disallow | /*go.php |
| Disallow | /*module%3Dhelp |
| Disallow | /*app%3Dmembers |
| Disallow | /*section%3Dmarkasread |
| Disallow | /*section%3Dfindpost |
| Disallow | /*view%3Dfindpost |
| Disallow | /*fromsearch |
| Disallow | /user/ |
| Disallow | /*sort_order |
| Disallow | /*sort_by |
| Disallow | /*sort_key |
| Disallow | /*unread/ |
| Disallow | /privacypolicy/ |
| Disallow | /best-content/ |
| Disallow | /mwshops/ |
| Disallow | /*getnextunread |
| Disallow | /statuses/ |
| Disallow | /*inapp%3D |
| Disallow | /*%3Dattach |
| Disallow | /*section%3Dlegends |
| Allow | /*.css |
| Allow | /*.CSS |
| Allow | /*.png |
| Allow | /*.PNG |
| Allow | /*.JPG |
| Allow | /*.jpg |
| Allow | /*.JPEG |
| Allow | /*.jpeg |
| Allow | /*.GIF |
| Allow | /*.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.masterwebs.ru/sitemap.xml |