loopnet.co.uk
robots.txt

Robots Exclusion Standard data for loopnet.co.uk

Resource Scan

Scan Details

Site Domain loopnet.co.uk
Base Domain loopnet.co.uk
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-13T20:56:10+00:00
Next Scan 2025-10-11T20:56:10+00:00

Last Successful Scan

Scanned2023-06-18T16:45:06+00:00
URL https://loopnet.co.uk/robots.txt
Redirect https://www.loopnet.co.uk/robots.txt
Redirect Domain www.loopnet.co.uk
Redirect Base loopnet.co.uk
Domain IPs 23.50.91.43
Redirect IPs 23.50.91.43
Response IP 104.69.43.30
Found Yes
Hash 5722f0b44bbe281b59fd20bc8cd30e8c1482fdfc324878978496b29b1579d8de
SimHash 6f4c5a31e5b3

Groups

criteobot/0.1

Rule Path
Allow /

*

Rule Path
Disallow /_criteo/
Disallow /locations/
Disallow /market/
Disallow /broker/
Disallow /error/error404/
Disallow /biz/images/shared/listings/
Disallow /xNet/
Disallow /xnet/
Disallow /map/
Disallow /property-record/map/
Disallow /looplink/search
Disallow /biz/services/exposure/v1/Exposure

Other Records

Field Value
sitemap https://www.loopnet.co.uk/sitemap_AllGBCountyPages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBCityByPropertyTypePages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBCityPages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBCountyByPropertyTypePages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBListing.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBPropertyTypePages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBRegionByPropertyTypePages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBRegionPages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBNeighborhoodPages.xml.gz
sitemap https://www.loopnet.co.uk/sitemap_AllGBNeighborhoodByPropertyTypePages.xml.gz