softwaresuggest.co.uk
robots.txt

Robots Exclusion Standard data for softwaresuggest.co.uk

Resource Scan

Scan Details

Site Domain softwaresuggest.co.uk
Base Domain softwaresuggest.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-22T18:54:30+00:00
Next Scan 2025-10-20T18:54:30+00:00

Last Successful Scan

Scanned2024-06-05T06:57:03+00:00
URL https://softwaresuggest.co.uk/robots.txt
Redirect https://www.softwaresuggest.com/robots.txt
Redirect Domain www.softwaresuggest.com
Redirect Base softwaresuggest.com
Domain IPs 104.21.10.28, 172.67.189.221, 2606:4700:3030::ac43:bddd, 2606:4700:3037::6815:a1c
Redirect IPs 104.26.4.245, 104.26.5.245, 172.67.75.38, 2606:4700:20::681a:4f5, 2606:4700:20::681a:5f5, 2606:4700:20::ac43:4b26
Response IP 172.67.75.38
Found Yes
Hash 634f1439092d2dfb2c155abbd05822124b12060d2b798c03d1b3246276383922
SimHash 22030ae0c0c2

Groups

*

Rule Path
Disallow /v2/
Disallow /v1/
Disallow /donotdo/
Disallow /v2_/
Disallow /v3/
Disallow /search.php
Disallow /newindex
Disallow /staging1
Disallow /staging2
Disallow /staging3
Disallow /adserver/
Disallow /woofu/
Disallow /woofubasic/
Disallow /?ilist=
Disallow /sdesign/
Disallow /cc/
Disallow /staging/
Disallow /newblog/
Disallow /sitespeed/
Disallow /wp-admin/
Disallow /itopsoftwares
Disallow /*/rating$
Disallow /?fp_ref=*
Disallow /leadermatrix/index?s=*
Disallow /blog/ebook_signup/?pdfurl=*
Disallow /cdn-cgi/
Disallow /blog/wp-admin/
Disallow /.well-known/
Disallow /sreviewall/
Disallow /*.php
Disallow /*/lquote
Disallow /*/landing
Disallow /*/et-cache
Disallow /profile/*

Other Records

Field Value
sitemap https://www.softwaresuggest.com/sitemaps/sitemap-all.xml