focus.pl
robots.txt

Robots Exclusion Standard data for focus.pl

Resource Scan

Scan Details

Site Domain focus.pl
Base Domain focus.pl
Scan Status Ok
Last Scan2025-09-29T02:41:19+00:00
Next Scan 2025-10-06T02:41:19+00:00

Last Scan

Scanned2025-09-29T02:41:19+00:00
URL https://focus.pl/robots.txt
Redirect https://www.focus.pl/robots.txt
Redirect Domain www.focus.pl
Redirect Base focus.pl
Domain IPs 104.26.2.211, 104.26.3.211, 172.67.71.226, 2606:4700:20::681a:2d3, 2606:4700:20::681a:3d3, 2606:4700:20::ac43:47e2
Redirect IPs 104.26.2.211, 104.26.3.211, 172.67.71.226, 2606:4700:20::681a:2d3, 2606:4700:20::681a:3d3, 2606:4700:20::ac43:47e2
Response IP 104.26.3.211
Found Yes
Hash fb5b5d2cc5dc0b7a9cdc408fbae37080121d55b30cd5c05074f51baf2b616cc6
SimHash 80119272c713

Groups

*

Rule Path
Allow /
Disallow /.next/
Disallow /_next/data/
Disallow /preview/
Disallow /ppp/
Disallow /undefined/
Disallow /null/
Disallow /api/
Disallow /?s=*
Disallow /search/*
Disallow /?q=*

Other Records

Field Value
sitemap https://www.focus.pl/sitemap_index.xml
sitemap https://www.focus.pl/news-sitemap.xml

Comments

  • Focus.pl robots.txt
  • ===================
  • Global rules
  • Prevent crawling search results to avoid search result spam
  • Sitemap