themenatech.com
robots.txt
Robots Exclusion Standard data for themenatech.com
Resource Scan
Scan Details
Site Domain | themenatech.com |
Base Domain | themenatech.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 5/27/2025, 1:21:29 PM |
Next Scan | 8/25/2025, 1:21:29 PM |
Last Successful Scan
Scanned | 9/11/2022, 12:56:23 AM |
URL | https://themenatech.com/robots.txt |
Redirect | https://github.com/robots.txt |
Redirect Domain | github.com |
Redirect Base | github.com |
Response IP | 20.205.243.166 |
Found | Yes |
Hash | dfdf51608accb4c4b0eb25c69bc30c101d3bd4a9e7062914071e50dddb0da343 |
SimHash | ee268bf13d91 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/pulse |
Disallow | /*/tree/ |
Disallow | /gist/ |
Disallow | /*/forks |
Disallow | /*/stars |
Disallow | /*/download |
Disallow | /*/revisions |
Disallow | /*/issues/new |
Disallow | /*/issues/search |
Disallow | /*/commits/ |
Disallow | /*/commits/*?author |
Disallow | /*/commits/*?path |
Disallow | /*/branches |
Disallow | /*/tags |
Disallow | /*/contributors |
Disallow | /*/comments |
Disallow | /*/stargazers |
Disallow | /*/archive/ |
Disallow | /*/blame/ |
Disallow | /*/watchers |
Disallow | /*/network |
Disallow | /*/graphs |
Disallow | /*/raw/ |
Disallow | /*/compare/ |
Disallow | /*/cache/ |
Disallow | /.git/ |
Disallow | */.git/ |
Disallow | /*.git$ |
Disallow | /search/advanced |
Disallow | /search |
Disallow | */search |
Disallow | /*q%3D |
Disallow | /*.atom |
Disallow | /ekansa/Open-Context-Data |
Disallow | /ekansa/opencontext-* |
Disallow | */tarball/ |
Disallow | */zipball/ |
Disallow | /*source%3D* |
Disallow | /*ref_cta%3D* |
Disallow | /*plan%3D* |
Disallow | /*return_to%3D* |
Disallow | /*ref_loc%3D* |
Disallow | /*setup_organization%3D* |
Disallow | /*source_repo%3D* |
Disallow | /*ref_page%3D* |
Disallow | /*source%3D* |
Disallow | /*referrer%3D* |
Disallow | /*report%3D* |
Disallow | /*author%3D* |
Disallow | /*since%3D* |
Disallow | /*until%3D* |
Disallow | /*commits?author=* |
Disallow | /*report-abuse?report=* |
Disallow | /*tab%3D* |
Allow | /*?tab=achievements&achievement=* |
Disallow | /account-login |
Disallow | /Explodingstuff/ |
Comments