masternaut.com
robots.txt
Robots Exclusion Standard data for masternaut.com
Resource Scan
Scan Details
Site Domain | masternaut.com |
Base Domain | masternaut.com |
Scan Status | Ok |
Last Scan | 2024-10-24T23:07:02+00:00 |
Next Scan | 2024-11-23T23:07:02+00:00 |
Last Scan
Scanned | 2024-10-24T23:07:02+00:00 |
URL | https://www.masternaut.com/robots.txt |
Domain IPs | 199.60.103.226, 199.60.103.30, 2606:2c40::c73c:671e, 2606:2c40::c73c:67e2 |
Response IP | 199.60.103.30 |
Found | Yes |
Hash | ec67cdc1995a2a67398392055e3fef4b0bf8a3483a8f79ce80a80afbaa12da52 |
SimHash | 7485d420f7b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /sample-* |
Disallow | /blog/sample-* |
Disallow | /hubfs/tcs/* |
Disallow | /hubfs/WEBSITE/UK/UK%20-%20TCS/UK%20-%20Docx/Non_index_DOCx/* |
Disallow | /hubfs/WEBSITE/UK/UK%20-%20TCS/UK%20-%20PDFs/Non_index_PDF/* |
Disallow | /hubfs/WEBSITE/FR/FR%20-%20TCS/FR%20-%20DOCx/Non_index_DOCx/* |
Disallow | /hubfs/WEBSITE/FR/FR%20-%20TCS/FR%20-%20PDFs/Non_index_PDF/* |
Disallow | /hubfs/WEBSITE/DE/DE%20-%20TCS/UK%20-%20Docx/Non_index_DOCx/* |
Disallow | /hubfs/WEBSITE/DE/DE%20-%20TCS/UK%20-%20Docx/Non_index_PDF/* |
Disallow | /hubfs/WEBSITE/ES/ES%20-%20TCS/UK%20-%20Docx/Non_index_PDF/* |
Disallow | /hubfs/WEBSITE/UK/UK%20-%20Campaigns/UK%20-%20CO2/Non_index_Images/* |
Disallow | /hubfs/WEBSITE/FR/FR%20-%20Campaigns/FR%20-%20Co2/Non_index_Images/* |
Disallow | /_hcms/preview/ |
Disallow | /hs/manage-preferences/ |
Disallow | /hs/preferences-center/ |
Disallow | /*?*hs_preview=* |
Disallow | /*?*hsCacheBuster=* |