Log In Sign Up

oferty.net
robots.txt

Robots Exclusion Standard data for oferty.net

Resource Scan

Scan Details

Site Domain oferty.net
Base Domain oferty.net
Scan Status Ok
Last Scan2024-11-09T23:27:00+00:00
Next Scan 2024-11-16T23:27:00+00:00

Last Scan

Scanned2024-11-09T23:27:00+00:00
URL https://oferty.net/robots.txt
Redirect https://www.oferty.net/robots.txt
Redirect Domain www.oferty.net
Redirect Base oferty.net
Domain IPs 85.232.249.60
Redirect IPs 85.232.249.60
Response IP 85.232.249.60
Found Yes
Hash 0f07ec84a85af76d5df93b02148ce0fb77927afeec6739fac1af67ddf7f6044f
SimHash 2e91d806e162

Groups

sistrix

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

seokicks robot

Rule Path
Disallow /

*

Rule Path
Disallow /podbicie/
Disallow /eksport
Disallow /regulamin/
Disallow /cennik
Disallow /wspolpraca/
Disallow /podbicia
Disallow /kontakt/
Disallow /kontakt-z-oferentem/
Disallow /en/promotion/
Disallow /de/promotion/
Disallow /requirementAdd/
Disallow /zapotrzebowan
Back to top

Other Records

Field Value
sitemap http://www.oferty.net/sitemaps_pl/sitemap.xml
Back to top

Comments

  • http://www.80legs.com/webcrawler.html
  • http://crawler.sistrix.net/
  • http://www.trendiction.de/bot
  • http://www.seokicks.de/robot.html
  • all spiders - keep at bottom
Back to top

Warnings

  • 2 invalid lines.
Back to top