Log In Sign Up

omnystudio.com
robots.txt

Robots Exclusion Standard data for omnystudio.com

Resource Scan

Scan Details

Site Domain omnystudio.com
Base Domain omnystudio.com
Scan Status Ok
Last Scan2024-10-31T06:14:22+00:00
Next Scan 2024-11-07T06:14:22+00:00

Last Scan

Scanned2024-10-31T06:14:22+00:00
URL https://omnystudio.com/robots.txt
Domain IPs 104.22.38.176, 104.22.39.176, 172.67.9.176, 2606:4700:10::6816:26b0, 2606:4700:10::6816:27b0, 2606:4700:10::ac43:9b0
Response IP 104.22.38.176
Found Yes
Hash eb09ea5f78640499cba0cbe670d36e02a4f7116b603fa18b09edf9ad1d4a2f21
SimHash e846d2b1c874

Groups

*

Rule Path
Allow /

test certificate info

Rule Path
Disallow /
Back to top

Comments

  • Attempt to block noisy test crawler that accesses malformed URLs
  • See http://www.diaryofaninja.com/blog/2012/10/02/the-pitfalls-of-cut-and-paste-coding
Back to top