staticoferty.net.pl
robots.txt

Robots Exclusion Standard data for staticoferty.net.pl

Resource Scan

Scan Details

Site Domain staticoferty.net.pl
Base Domain staticoferty.net.pl
Scan Status Ok
Last Scan2025-12-01T00:19:24+00:00
Next Scan 2025-12-08T00:19:24+00:00

Last Scan

Scanned2025-12-01T00:19:24+00:00
URL https://staticoferty.net.pl/robots.txt
Domain IPs 104.21.54.231, 172.67.143.32, 2606:4700:3035::6815:36e7, 2606:4700:3037::ac43:8f20
Response IP 172.67.143.32
Found Yes
Hash 0f07ec84a85af76d5df93b02148ce0fb77927afeec6739fac1af67ddf7f6044f
SimHash 2e91d806e162

Groups

sistrix

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

seokicks robot

Rule Path
Disallow /

*

Rule Path
Disallow /podbicie/
Disallow /eksport
Disallow /regulamin/
Disallow /cennik
Disallow /wspolpraca/
Disallow /podbicia
Disallow /kontakt/
Disallow /kontakt-z-oferentem/
Disallow /en/promotion/
Disallow /de/promotion/
Disallow /requirementAdd/
Disallow /zapotrzebowan

Other Records

Field Value
sitemap http://www.oferty.net/sitemaps_pl/sitemap.xml

Comments

  • http://www.80legs.com/webcrawler.html
  • http://crawler.sistrix.net/
  • http://www.trendiction.de/bot
  • http://www.seokicks.de/robot.html
  • all spiders - keep at bottom

Warnings

  • 2 invalid lines.