relativity.one
robots.txt
Robots Exclusion Standard data for relativity.one
Resource Scan
Scan Details
Site Domain | relativity.one |
Base Domain | relativity.one |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-20T21:02:53+00:00 |
Next Scan | 2024-10-18T21:02:53+00:00 |
Last Successful Scan
Scanned | 2024-02-29T21:01:05+00:00 |
URL | http://relativity.one/robots.txt |
Redirect | https://www.relativity.com/relativity/robots.txt |
Redirect Domain | www.relativity.com |
Redirect Base | relativity.com |
Domain IPs | 54.88.2.191 |
Redirect IPs | 2600:9000:20c7:1200:15:9612:b200:93a1, 2600:9000:20c7:1a00:15:9612:b200:93a1, 2600:9000:20c7:3200:15:9612:b200:93a1, 2600:9000:20c7:8c00:15:9612:b200:93a1, 2600:9000:20c7:9800:15:9612:b200:93a1, 2600:9000:20c7:a000:15:9612:b200:93a1, 2600:9000:20c7:a400:15:9612:b200:93a1, 2600:9000:20c7:c800:15:9612:b200:93a1, 52.84.251.122, 52.84.251.23, 52.84.251.56, 52.84.251.84 |
Response IP | 52.84.251.23 |
Found | Yes |
Hash | 1b22789f9b5cd4bcde169c67d01d1d314f46debbe23d78572f6462eaddd813cc |
SimHash | 6959d8555781 |
Groups
*
Rule | Path |
---|---|
Disallow | /CFIDE/* |
Disallow | /Portal/* |
Disallow | /Portals/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |