cdn.ilovefreesoftware.com
robots.txt

Robots Exclusion Standard data for cdn.ilovefreesoftware.com

Resource Scan

Scan Details

Site Domain cdn.ilovefreesoftware.com
Base Domain ilovefreesoftware.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-10T13:38:40+00:00
Next Scan 2025-11-08T13:38:40+00:00

Last Successful Scan

Scanned2024-03-26T13:17:35+00:00
URL https://cdn.ilovefreesoftware.com/robots.txt
Redirect https://www.ilovefreesoftware.com/robots.txt
Redirect Domain www.ilovefreesoftware.com
Redirect Base ilovefreesoftware.com
Domain IPs 209.58.173.178
Redirect IPs 209.58.167.25
Response IP 209.58.167.25
Found Yes
Hash 265553a70f224e0f449d597654eaefb068dda6f6c6eddb69e3d61b1e56d4f68c
SimHash b8109a62fbb2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /search/*
Disallow /tag/*

*

Rule Path
Disallow /*?s=*