heartlight.org
robots.txt
Robots Exclusion Standard data for heartlight.org
Resource Scan
Scan Details
| Site Domain | heartlight.org |
| Base Domain | heartlight.org |
| Scan Status | Ok |
| Last Scan | 2024-10-02T23:48:23+00:00 |
| Next Scan | 2024-10-09T23:48:23+00:00 |
Last Scan
| Scanned | 2024-10-02T23:48:23+00:00 |
| URL | https://heartlight.org/robots.txt |
| Redirect | https://www.heartlight.org/robots.txt |
| Redirect Domain | www.heartlight.org |
| Redirect Base | heartlight.org |
| Domain IPs | 162.243.123.59 |
| Redirect IPs | 162.243.123.59 |
| Response IP | 162.243.123.59 |
| Found | Yes |
| Hash | 2e0b20315f21b9830a7601ae62c2b563eacc79da196bc9b512deb9011fdbe5c4 |
| SimHash | 3b7e43d3e23b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-shl/admin/ |
| Disallow | /cgi/admin/ |
| Disallow | /cgi-shl/forward.cgi |
| Disallow | /cgi-shl/simplify.cgi |
| Disallow | /cgi-shl/search.cgi |
| Disallow | /cgi/forward.cgi |
| Disallow | /cgi/simplify.cgi |
| Disallow | /cgi/search.cgi |
| Disallow | /comments/ |
| Disallow | /errors/ |
| Disallow | /rss/track/ |
| Disallow | /rss/author/ |
| Disallow | /art/ |
| Disallow | /audio/ |
| Disallow | /clips/ |
| Disallow | /art-music/ |
| Disallow | /wallpaper/ |
| Disallow | /search/ |
| Disallow | /help/ |
| Disallow | /links/ |
| Disallow | /guestbook/ |
| Disallow | /guestbook |
| Disallow | /cgi-shl/board/ |
| Disallow | /cgi-shl/forward.cgi |
| Disallow | /cgi/forward.cgi |
| Disallow | /cgi-shl/simplify.cgi |
| Disallow | /cgi/simplify.cgi |
| Disallow | /cgi-shl/search.cgi |
| Disallow | /cgi-shl/passiton.cgi |
| Disallow | /cgi-shl/cardedit.pl |
| Disallow | /dymations/ |
| Disallow | /dynimation/ |
| Disallow | /support/promo/ |
| Disallow | /thephilfiles/ |
| Disallow | /cbd/ |
| Disallow | /fast/ |
| Disallow | /articles/2000 |
| Disallow | /articles/2001 |
| Disallow | /articles/2002 |
| Disallow | /articles/2003 |
| Disallow | /cgi-shl/my_utmost/utm.cgi |
htdig
| Rule | Path |
|---|---|
| Disallow | /cgi-shl/admin/ |
| Disallow | /cgi/admin/ |
| Disallow | /cgi-shl/forward.cgi |
| Disallow | /cgi-shl/simplify.cgi |
| Disallow | /cgi-shl/search.cgi |
| Disallow | /cgi/forward.cgi |
| Disallow | /cgi/search.cgi |
| Disallow | /comments/ |
| Disallow | /errors/ |
| Disallow | /rss/track/ |
| Disallow | /rss/author/ |
| Disallow | /art/ |
| Disallow | /art-music/ |
| Disallow | /wallpaper/ |
| Disallow | /ssi/ |
| Disallow | /fromtheheart/ |
| Disallow | /art-music/ |
| Disallow | /search/ |
| Disallow | /help/ |
| Disallow | /thecoffeegroup/ |
| Disallow | /gallery/james1_17.html |
| Disallow | /gallery/ephesians4_3.html |
| Disallow | /gallery/acts3_19.html |
| Disallow | /gallery/psalm46_10.html |
| Disallow | /gallery/popular/ |
| Disallow | /gallery/new/ |
| Disallow | /powerpoint/popular/ |
| Disallow | /powerpoint/new/ |
| Disallow | /gallery/tag/free/ |
| Disallow | /gallery/tag/keep/ |
| Disallow | /gallery/tag/merry_christmas/ |
| Disallow | /gallery/tag/god%27s_love/ |
| Disallow | /gallery/tag/test/ |
| Disallow | /powerpoint/tag/test/ |
| Disallow | /spiritfire/ |
| Disallow | /support/promo/ |
rogerbot
| Rule | Path |
|---|---|
| Disallow | /feature/ |
| Disallow | /two_minute/ |
| Disallow | /timely_truths/ |
| Disallow | /seminars/ |
| Disallow | /laos/ |
| Disallow | /links/ |
| Disallow | /hope/ |
| Disallow | /together/ |
| Disallow | /caring_touch/ |
| Disallow | /resources/ |
| Disallow | /family/ |
| Disallow | /home/ |
| Disallow | /single/ |
| Disallow | /justformen/ |
| Disallow | /justforwomen/ |
| Disallow | /diary/ |
| Disallow | /heartsounds/ |
| Disallow | /mbed/ |
| Disallow | /lighthearted/ |
| Disallow | /heart2heart/ |
| Disallow | /prayerforthenation/ |
| Disallow | /cgi-shl/forward.cgi |
| Disallow | /cgi-shl/simplify.cgi |
| Disallow | /cgi/simplify.cgi |
| Disallow | /cgi-shl/search.cgi |
| Disallow | /cgi/forward.cgi |
| Disallow | /guestbook/ |
| Disallow | /dynimation/ |
| Disallow | /thephilfiles/ |
| Disallow | /audio/ |
| Disallow | /clips/ |
| Disallow | /cgi-bin/ |
| Disallow | /cgi-shl/passiton.cgi |
| Disallow | /cgi-shl/board/ |
| Disallow | /cgi-shl/admin/ |
| Disallow | /search/ |
| Disallow | /prayerplans/ |
| Disallow | /articles/2000 |
| Disallow | /articles/2001 |
| Disallow | /articles/2002 |
| Disallow | /articles/2003 |
| Disallow | /cgi-shl/my_utmost/utm.cgi |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Comments