twitter4j.org
robots.txt
Robots Exclusion Standard data for twitter4j.org
Resource Scan
Scan Details
Site Domain | twitter4j.org |
Base Domain | twitter4j.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-25T21:21:28+00:00 |
Next Scan | 2024-08-23T21:21:28+00:00 |
Last Successful Scan
Scanned | 2022-10-08T18:34:09+00:00 |
URL | https://twitter4j.org/robots.txt |
Response IP | 54.192.150.99, 54.192.150.91, 54.192.150.74, 54.192.150.97 |
Found | Yes |
Hash | 4b6b49491e69e42591fff1dcca2dd9b959f636c33459367d33c3eba355b0aea0 |
SimHash | 184fca486933 |
Groups
*
Rule | Path |
---|---|
Disallow | /svn/ |
Disallow | /svnwebclient/ |
Disallow | /diary/blogentries/ |
Disallow | /diary/categories/ |
Disallow | /bbs/ |
Disallow | /fisheye/ |
Disallow | /jira/sr/ |
Disallow | /jira/si/ |
Disallow | /mt/ |
Disallow | /hudson/ |
Disallow | /en/oldjavadocs/ |
Disallow | /ja/oldjavadocs/ |