Log In Sign Up

rs.agrofoto.pl
robots.txt

Robots Exclusion Standard data for rs.agrofoto.pl

Resource Scan

Scan Details

Site Domain rs.agrofoto.pl
Base Domain agrofoto.pl
Scan Status Ok
Last Scan2026-03-05T01:05:40+00:00
Next Scan 2026-03-19T01:05:40+00:00

Last Scan

Scanned2026-03-05T01:05:40+00:00
URL https://rs.agrofoto.pl/robots.txt
Domain IPs 136.243.115.98
Response IP 136.243.115.98
Found Yes
Hash 2ccec4f22a487e8242a49f4b5ab6c5698e747cbc9717a9b9c5283771813ee796
SimHash ca1a495f0bd0

Groups

*

Rule Path
Disallow /
Back to top

Comments

  • Sample robots.txt file - ensures that a Google Appliance can still access the spider page (if configured)
  • and assumes an installation in the site root. For sites in a subfolder you must move the robots.txt file
  • to the site root and alter the paths accordingly.
  • User-agent: *
  • Crawl-delay: 10
  • Disallow : /filestore
Back to top