jigsawconferences.co.uk
robots.txt

Robots Exclusion Standard data for jigsawconferences.co.uk

Resource Scan

Scan Details

Site Domain jigsawconferences.co.uk
Base Domain jigsawconferences.co.uk
Scan Status Ok
Last Scan2025-08-26T10:54:20+00:00
Next Scan 2025-09-25T10:54:20+00:00

Last Scan

Scanned2025-08-26T10:54:20+00:00
URL https://jigsawconferences.co.uk/robots.txt
Domain IPs 104.26.0.165, 104.26.1.165, 172.67.74.73, 2606:4700:20::681a:1a5, 2606:4700:20::681a:a5, 2606:4700:20::ac43:4a49
Response IP 104.26.0.165
Found Yes
Hash 8ddd1a7834392ff7519f668f4268fcc305b10af6075831ebca8e4cbb9ec285c9
SimHash 6f04e240d220

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /portal/
Disallow /writer/
Disallow /e20/
Disallow /A2/
Disallow /api/
Disallow /login
Disallow /register
Disallow /*?*
Allow /services/
Allow /services/venue-finding
Allow /services/corporate-accommodation
Allow /services/emergency-accommodation
Allow /services/corporate-relocation
Allow /services/travel-management
Allow /services/procurement
Allow /blog/
Allow /london-venues
Allow /london
Allow /birmingham
Allow /manchester
Allow /glasgow
Allow /edinburgh
Allow /leeds
Allow /liverpool
Allow /bristol
Allow /conference-venues
Allow /meeting-rooms
Allow /sitemap
Allow /about
Allow /contact

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.jigsawconferences.co.uk/sitemap.xml
sitemap https://www.jigsawconferences.co.uk/eu-sitemap.xml
sitemap https://www.jigsawconferences.co.uk/asia-sitemap.xml

Comments

  • Exclude sensitive or non-public areas
  • Allow key public services & pages
  • Set polite crawl speed
  • Sitemaps