download.net.pl
robots.txt

Robots Exclusion Standard data for download.net.pl

Resource Scan

Scan Details

Site Domain download.net.pl
Base Domain download.net.pl
Scan Status Ok
Last Scan2025-06-03T17:06:53+00:00
Next Scan 2025-06-10T17:06:53+00:00

Last Scan

Scanned2025-06-03T17:06:53+00:00
URL https://download.net.pl/robots.txt
Redirect https://www.download.net.pl/robots.txt
Redirect Domain www.download.net.pl
Redirect Base download.net.pl
Domain IPs 5.252.229.24
Redirect IPs 5.252.229.24
Response IP 5.252.229.24
Found Yes
Hash 60a88b625fe0d382d05b2f426216676b182039ed3af4f57af29b9177846d20ba
SimHash 4f54d7e49191

Groups

*

Rule Path
Disallow /user/
Disallow */vote-answer/
Disallow */vote-question/
Disallow *sort%3D*
Disallow *alphabetasc$
Allow /

mediapartners-google

Rule Path
Allow /
Disallow /user/

adsbot-google

Rule Path
Allow /
Disallow /user/

Other Records

Field Value
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_news_0.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_files_0.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_files_1.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_files_2.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_files_3.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_categories_0.xml
sitemap https://www.download.net.pl/sitemaps/pl/sitemap_home.xml