gulfoilltd.com
robots.txt
Robots Exclusion Standard data for gulfoilltd.com
Resource Scan
Scan Details
Site Domain | gulfoilltd.com |
Base Domain | gulfoilltd.com |
Scan Status | Ok |
Last Scan | 2024-10-26T18:35:44+00:00 |
Next Scan | 2024-11-25T18:35:44+00:00 |
Last Scan
Scanned | 2024-10-26T18:35:44+00:00 |
URL | https://gulfoilltd.com/robots.txt |
Redirect | https://www.gulfoilltd.com/robots.txt |
Redirect Domain | www.gulfoilltd.com |
Redirect Base | gulfoilltd.com |
Domain IPs | 13.35.238.107, 13.35.238.129, 13.35.238.2, 13.35.238.4, 2600:9000:2085:2400:2:1c52:6a00:93a1, 2600:9000:2085:2600:2:1c52:6a00:93a1, 2600:9000:2085:6200:2:1c52:6a00:93a1, 2600:9000:2085:a600:2:1c52:6a00:93a1, 2600:9000:2085:c200:2:1c52:6a00:93a1, 2600:9000:2085:c400:2:1c52:6a00:93a1, 2600:9000:2085:ea00:2:1c52:6a00:93a1, 2600:9000:2085:f200:2:1c52:6a00:93a1 |
Redirect IPs | 13.35.238.107, 13.35.238.129, 13.35.238.2, 13.35.238.4, 2600:9000:2085:7c00:2:1c52:6a00:93a1, 2600:9000:2085:8400:2:1c52:6a00:93a1, 2600:9000:2085:8600:2:1c52:6a00:93a1, 2600:9000:2085:8a00:2:1c52:6a00:93a1, 2600:9000:2085:a600:2:1c52:6a00:93a1, 2600:9000:2085:bc00:2:1c52:6a00:93a1, 2600:9000:2085:c800:2:1c52:6a00:93a1, 2600:9000:2085:f200:2:1c52:6a00:93a1 |
Response IP | 13.35.238.129 |
Found | Yes |
Hash | 9fbadbc7d1102c07bb2223fa0221dc54beead63581c5e5ecf02b8e6e3958e7e8 |
SimHash | 7516041607f2 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /quicktabs |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.txt |
Disallow | /web.config |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register |
Disallow | /user/password |
Disallow | /user/login |
Disallow | /user/logout |
Disallow | /heritage/ |
Disallow | /heritage/* |
Disallow | /leadership/ |
Disallow | /leadership/* |
Disallow | /node/ |
Disallow | /node/* |
Disallow | /taxonomy/term/ |
Disallow | /taxonomy/term/* |
Disallow | /quicktabs/nojs/global_sites_popup/ |
Disallow | /quicktabs/nojs/global_sites_popup/* |
Disallow | /quicktabs/nojs/global_sites_popup/* |
Disallow | /search |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips |
Disallow | /index.php/node/add/ |
Disallow | /index.php/search/ |
Disallow | /index.php/user/password |
Disallow | /index.php/user/register |
Disallow | /index.php/user/login |
Disallow | /index.php/user/logout |
Other Records
Field | Value |
---|---|
sitemap | https://www.gulfoilltd.com/sitemap.xml |
sitemap | https://www.gulfoilltd.com/sitemap.xml |
Comments