download.net.pl
robots.txt
Robots Exclusion Standard data for download.net.pl
Resource Scan
Scan Details
Site Domain | download.net.pl |
Base Domain | download.net.pl |
Scan Status | Ok |
Last Scan | 2025-06-03T17:06:53+00:00 |
Next Scan | 2025-06-10T17:06:53+00:00 |
Last Scan
Scanned | 2025-06-03T17:06:53+00:00 |
URL | https://download.net.pl/robots.txt |
Redirect | https://www.download.net.pl/robots.txt |
Redirect Domain | www.download.net.pl |
Redirect Base | download.net.pl |
Domain IPs | 5.252.229.24 |
Redirect IPs | 5.252.229.24 |
Response IP | 5.252.229.24 |
Found | Yes |
Hash | 60a88b625fe0d382d05b2f426216676b182039ed3af4f57af29b9177846d20ba |
SimHash | 4f54d7e49191 |
Groups
*
Rule | Path |
---|---|
Disallow | /user/ |
Disallow | */vote-answer/ |
Disallow | */vote-question/ |
Disallow | *sort%3D* |
Disallow | *alphabetasc$ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_news_0.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_files_0.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_files_1.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_files_2.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_files_3.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_categories_0.xml |
sitemap | https://www.download.net.pl/sitemaps/pl/sitemap_home.xml |