me.gulfoilltd.com
robots.txt
Robots Exclusion Standard data for me.gulfoilltd.com
Resource Scan
Scan Details
Site Domain | me.gulfoilltd.com |
Base Domain | gulfoilltd.com |
Scan Status | Ok |
Last Scan | 2024-04-28T03:03:27+00:00 |
Next Scan | 2024-05-28T03:03:27+00:00 |
Last Scan
Scanned | 2024-04-28T03:03:27+00:00 |
URL | https://me.gulfoilltd.com/robots.txt |
Domain IPs | 108.157.254.110, 108.157.254.116, 108.157.254.34, 108.157.254.48, 2600:9000:2753:1e00:1b:4cca:c800:93a1, 2600:9000:2753:200:1b:4cca:c800:93a1, 2600:9000:2753:4400:1b:4cca:c800:93a1, 2600:9000:2753:5400:1b:4cca:c800:93a1, 2600:9000:2753:6e00:1b:4cca:c800:93a1, 2600:9000:2753:8800:1b:4cca:c800:93a1, 2600:9000:2753:a000:1b:4cca:c800:93a1, 2600:9000:2753:e00:1b:4cca:c800:93a1 |
Response IP | 108.157.254.34 |
Found | Yes |
Hash | aff1d78f8415b3e637c64d1d72acac52902440e848eb0d802162cd26ffd7845e |
SimHash | 7114040607f0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cgi-bin/ |
Disallow | /quicktabs |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.txt |
Disallow | /web.config |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register |
Disallow | /user/password |
Disallow | /user/login |
Disallow | /user/logout |
Disallow | /heritage/ |
Disallow | /heritage/* |
Disallow | /leadership/ |
Disallow | /leadership/* |
Disallow | /dealer-locator-data/* |
Disallow | /node/ |
Disallow | /node/* |
Disallow | /taxonomy/term/ |
Disallow | /taxonomy/term/* |
Disallow | /quicktabs/nojs/global_sites_popup/ |
Disallow | /quicktabs/nojs/global_sites_popup/* |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips |
Disallow | /index.php/node/add/ |
Disallow | /index.php/search/ |
Disallow | /index.php/user/password |
Disallow | /index.php/user/register |
Disallow | /index.php/user/login |
Disallow | /index.php/user/logout |
Other Records
Field | Value |
---|---|
sitemap | https://me.gulfoilltd.com/sitemap.xml |
sitemap | https://me.gulfoilltd.com/sitemap.xml |
Comments