gulfoilltd.com
robots.txt
Robots Exclusion Standard data for gulfoilltd.com
Resource Scan
Scan Details
| Site Domain | gulfoilltd.com |
| Base Domain | gulfoilltd.com |
| Scan Status | Ok |
| Last Scan | 2024-06-28T18:18:02+00:00 |
| Next Scan | 2024-07-28T18:18:02+00:00 |
Last Scan
| Scanned | 2024-06-28T18:18:02+00:00 |
| URL | https://gulfoilltd.com/robots.txt |
| Domain IPs | 13.35.18.14, 13.35.18.19, 13.35.18.40, 13.35.18.74, 2600:9000:20c7:1600:2:1c52:6a00:93a1, 2600:9000:20c7:4a00:2:1c52:6a00:93a1, 2600:9000:20c7:5000:2:1c52:6a00:93a1, 2600:9000:20c7:5600:2:1c52:6a00:93a1, 2600:9000:20c7:8000:2:1c52:6a00:93a1, 2600:9000:20c7:8c00:2:1c52:6a00:93a1, 2600:9000:20c7:9a00:2:1c52:6a00:93a1, 2600:9000:20c7:bc00:2:1c52:6a00:93a1 |
| Response IP | 13.35.18.40 |
| Found | Yes |
| Hash | 942d0308c4507230e3e37576a9c5f7ef70c8254e787e51ddbbf24e01fd506719 |
| SimHash | 6516040606fa |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin/ |
| Disallow | /quicktabs |
| Disallow | /core/ |
| Disallow | /profiles/ |
| Disallow | /README.txt |
| Disallow | /web.config |
| Disallow | /admin/ |
| Disallow | /comment/reply/ |
| Disallow | /filter/tips |
| Disallow | /node/add/ |
| Disallow | /search/ |
| Disallow | /user/register |
| Disallow | /user/password |
| Disallow | /user/login |
| Disallow | /user/logout |
| Disallow | /heritage/ |
| Disallow | /heritage/* |
| Disallow | /leadership/ |
| Disallow | /leadership/* |
| Disallow | /node/ |
| Disallow | /node/* |
| Disallow | /taxonomy/term/ |
| Disallow | /taxonomy/term/* |
| Disallow | /quicktabs/nojs/global_sites_popup/ |
| Disallow | /quicktabs/nojs/global_sites_popup/* |
| Disallow | /quicktabs/nojs/global_sites_popup/* |
| Disallow | /search |
| Disallow | /index.php/admin/ |
| Disallow | /index.php/comment/reply/ |
| Disallow | /index.php/filter/tips |
| Disallow | /index.php/node/add/ |
| Disallow | /index.php/search/ |
| Disallow | /index.php/user/password |
| Disallow | /index.php/user/register |
| Disallow | /index.php/user/login |
| Disallow | /index.php/user/logout |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gulfoilltd.com/sitemap.xml |
| sitemap | https://gulfoilltd.com/sitemap.xml |
Comments