lfclive.net
robots.txt
Robots Exclusion Standard data for lfclive.net
Resource Scan
Scan Details
| Site Domain | lfclive.net |
| Base Domain | lfclive.net |
| Scan Status | Ok |
| Last Scan | 2024-11-15T19:06:58+00:00 |
| Next Scan | 2024-11-22T19:06:58+00:00 |
Last Scan
| Scanned | 2024-11-15T19:06:58+00:00 |
| URL | https://lfclive.net/robots.txt |
| Redirect | https://www.lfclive.net/robots.txt |
| Redirect Domain | www.lfclive.net |
| Redirect Base | lfclive.net |
| Domain IPs | 104.21.0.117, 172.67.150.237, 2606:4700:3037::6815:75, 2606:4700:3037::ac43:96ed |
| Redirect IPs | 104.21.0.117, 172.67.150.237, 2606:4700:3037::6815:75, 2606:4700:3037::ac43:96ed |
| Response IP | 104.21.0.117 |
| Found | Yes |
| Hash | 52c972ed2a75132140b2be566623afab07151d5cc1a54b95180923eac4c150c9 |
| SimHash | 78201c2048f2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /removecommon.php |
| Disallow | /errorpages/ |
| Disallow | /test.php |
| Disallow | /test2.php |
| Disallow | /cloud.php |
| Disallow | /geoip.php |
| Disallow | /imgtest.txt |
| Disallow | /linked.php |
| Disallow | /mysql.php |
| Disallow | /rss_cache.inc |
| Disallow | /rss_fetch.inc |
| Disallow | /rss_parse.inc |
| Disallow | /rss_utils.php |
| Disallow | /summy.php |
| Disallow | /Twitter.php |
| Disallow | /twitter.class.php |
| Disallow | /stopwords.txt |
| Disallow | /OAuth.php |
| Disallow | /nextmatch.txt |
| Disallow | /hourlytweet.php |
| Disallow | /byclicks.php |
| Disallow | /byblogs.php |
| Disallow | /bylatest.php |
| Disallow | /bynewsonly.php |
| Disallow | /bygrouped.php |
| Disallow | /archive/ |
| Disallow | /cache/ |
| Disallow | /extlib/ |
| Disallow | /geoip/ |
| Disallow | /magpierss/ |
| Disallow | /tmp/ |
| Disallow | /errorpages/ |
| Disallow | /scripts/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lfclive.net/sitemap.xml |