setka.media
robots.txt

Robots Exclusion Standard data for setka.media

Resource Scan

Scan Details

Site Domain setka.media
Base Domain setka.media
Scan Status Ok
Last Scan2024-11-14T11:09:18+00:00
Next Scan 2024-11-21T11:09:18+00:00

Last Scan

Scanned2024-11-14T11:09:18+00:00
URL https://setka.media/robots.txt
Domain IPs 176.58.34.241
Response IP 176.58.34.241
Found Yes
Hash 2be48f6d4f5ba39ab201bd7e1fe38a992fc7f2b8097f85718aa0b47a287ce033
SimHash 76a56d0d65d0

Groups

*

Rule Path
Disallow /teaser-url?

Comments

  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /