compare5g.com
robots.txt

Robots Exclusion Standard data for compare5g.com

Resource Scan

Scan Details

Site Domain compare5g.com
Base Domain compare5g.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-05-09T18:19:10+00:00
Next Scan 2025-08-07T18:19:10+00:00

Last Successful Scan

Scanned2024-06-21T10:15:09+00:00
URL https://compare5g.com/robots.txt
Domain IPs 104.21.15.162, 172.67.163.30, 2606:4700:3033::ac43:a31e, 2606:4700:3034::6815:fa2
Response IP 104.21.15.162
Found Yes
Hash 6b3f7c91c84119ae51d6c1830475157cf41d81720f078dfa0cb0dc7beec08ebb
SimHash 480449418e52

Groups

blexbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /uk/redirect
Disallow /us/redirect
Disallow /us/es/redirect
Disallow /ie/redirect
Disallow /ca/redirect
Disallow /ca/fr/redirect
Disallow /au/redirect
Disallow /nz/redirect

Other Records

Field Value
sitemap https://compare5g.com/sitemap.xml