mgsm.pl
robots.txt
Robots Exclusion Standard data for mgsm.pl
Resource Scan
Scan Details
| Site Domain | mgsm.pl |
| Base Domain | mgsm.pl |
| Scan Status | Ok |
| Last Scan | 2024-11-02T06:45:18+00:00 |
| Next Scan | 2024-11-09T06:45:18+00:00 |
Last Scan
| Scanned | 2024-11-02T06:45:18+00:00 |
| URL | https://mgsm.pl/robots.txt |
| Domain IPs | 213.189.55.209 |
| Response IP | 213.189.55.209 |
| Found | Yes |
| Hash | dbaa74a51ba52d9233d8850ddcfbc732b9e5a035ffa84fe8d82d592a7e50ef1b |
| SimHash | c32c1fc6473c |
Groups
bingbot
duckduckbot
applebot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Disallow | /gizmo/ |
| Disallow | /pic/CVS/ |
| Disallow | /pic/ads_imgs/ |
| Disallow | /pic/apple_ads/ |
| Disallow | /pic/brands/ |
| Disallow | /pic/friends/ |
| Disallow | /pic/gielda/ |
| Disallow | /pic/gsmchoice/ |
| Disallow | /pic/icons/ |
| Disallow | /pic/naviexpert/ |
| Disallow | /pic/news/ |
| Disallow | /pic/reklama/ |
| Disallow | /pic/slowniczek/ |
| Disallow | /pic/users_avatars/ |
| Disallow | /pic/users_imgs/ |
| Disallow | /pic/users_img_tmp/ |
| Disallow | /me/ |
| Disallow | /pic/*.gif$ |
| Disallow | /pic/*.png$ |
| Disallow | /imager_res/ |
| Disallow | /soap/ |
| Disallow | /CVS/ |
| Disallow | /monitor/ |
| Disallow | /fun/ |
| Disallow | /*porownania/ |
| Disallow | /*advanced_search/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mgsm.pl/sitemap-index.xml |
| sitemap | https://www.mgsm.pl/sitemap-index.xml |
Comments