4gon.co.uk
robots.txt

Robots Exclusion Standard data for 4gon.co.uk

Resource Scan

Scan Details

Site Domain 4gon.co.uk
Base Domain 4gon.co.uk
Scan Status Ok
Last Scan2026-01-31T19:56:57+00:00
Next Scan 2026-03-02T19:56:57+00:00

Last Scan

Scanned2026-01-31T19:56:57+00:00
URL https://4gon.co.uk/robots.txt
Domain IPs 104.26.0.176, 104.26.1.176, 172.67.69.249, 2606:4700:20::681a:1b0, 2606:4700:20::681a:b0, 2606:4700:20::ac43:45f9
Response IP 172.67.69.249
Found Yes
Hash 1e6e15637f364e29da590f8a4192c37d4588e083196a688d01f5429507bb063a
SimHash d45c14264e50

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /account.php
Disallow /includes/
Disallow /landing/
Disallow /login.php
Disallow /checkout_success.php
Disallow /help/
Disallow /digium-analog-cards-digium-tdm2400p-c-23_39_66.html
Disallow /ubiquiti-unifi-lp.php
Disallow /sangoma-asterisk-cards-sangoma-pri-cards-c-23_54.html
Disallow /wireless-ip-telephones-pirelli-sipgsm-telephone-c-1_95.html
Disallow /digium-analog-cards-digium-aex800-pci-express-c-23_39_182.html
Disallow /digium-asterisk-cards-digium-analog-cards-c-23_39.html
Disallow /asterisk-hardware-digium-analog-cards-c-23_39.html
Disallow /snom-m-21.html?currency=GBP&amp%3Bsort=2a&filter_id=153
Disallow /snom-m-21.html?filter_id=153&amp%3Bsort=3a
Disallow /wireless-ip-telephones-c-148.html?currency=USD
Disallow /grandstream-m-25.html?sort=2a
Disallow /grandstream-m-25.html?currency=GBP&sort=2d&page=1
Disallow /grandstream-m-25.html?currency=GBP&page=1&sort=3a
Disallow /grandstream-m-25.html?filter_id=58&amp%3Bsort=3a
Disallow /grandstream-m-25.html?sort=2d&page=1&filter_id=188&amp%3Bsort=2a&currency=USD
Disallow /grandstream-m-25.html?currency=GBP&sort=3a&page=1&filter_id=151&amp%3Bsort=2a
Disallow /grandstream-m-25.html?sort=3a&page=1&filter_id=188&amp%3Bsort=2d
Disallow /grandstream-m-25.html?currency=GBP&sort=3d&page=1&amp%3Bsort=2a&

yandex

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 2 specifies a delay of 2 seconds

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Comments

  • SemRush allowed - requested May 2023
  • User-agent: SemrushBot
  • Disallow: /
  • User-agent: SemrushBot-SA
  • Disallow: /