forum.hr
robots.txt
Robots Exclusion Standard data for forum.hr
Resource Scan
Scan Details
| Site Domain | forum.hr |
| Base Domain | forum.hr |
| Scan Status | Ok |
| Last Scan | 2024-05-28T15:41:35+00:00 |
| Next Scan | 2024-06-04T15:41:35+00:00 |
Last Scan
| Scanned | 2024-05-28T15:41:35+00:00 |
| URL | https://forum.hr/robots.txt |
| Redirect | https://www.forum.hr/robots.txt |
| Redirect Domain | www.forum.hr |
| Redirect Base | forum.hr |
| Domain IPs | 104.21.89.186, 172.67.191.4, 2606:4700:3032::6815:59ba, 2606:4700:3037::ac43:bf04 |
| Redirect IPs | 104.21.89.186, 172.67.191.4, 2606:4700:3032::6815:59ba, 2606:4700:3037::ac43:bf04 |
| Response IP | 104.21.89.186 |
| Found | Yes |
| Hash | 8859f5bcefe0f3e1c0251a8e1e8e166593fe183301337a66b8aa6a8ff6b5dccc |
| SimHash | af16c2d1c746 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admincp/ |
| Disallow | /modcp/ |
| Disallow | /ajax.php |
| Disallow | /attachment.php |
| Disallow | /calendar.php |
| Disallow | /cron.php |
| Disallow | /editpost.php |
| Disallow | /global.php |
| Disallow | /image.php |
| Disallow | /inlinemod.php |
| Disallow | /joinrequests.php |
| Disallow | /login.php |
| Disallow | /member.php |
| Disallow | /memberlist.php |
| Disallow | /misc.php |
| Disallow | /moderator.php |
| Disallow | /newattachment.php |
| Disallow | /newreply.php |
| Disallow | /newthread.php |
| Disallow | /online.php |
| Disallow | /poll.php |
| Disallow | /postings.php |
| Disallow | /printthread.php |
| Disallow | /private.php |
| Disallow | /profile.php |
| Disallow | /register.php |
| Disallow | /report.php |
| Disallow | /reputation.php |
| Disallow | /search.php |
| Disallow | /sendmessage.php |
| Disallow | /showgroups.php |
| Disallow | /subscription.php |
| Disallow | /threadrate.php |
| Disallow | /usercp.php |
| Disallow | /usernote.php |
| Disallow | /sendtofriend.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 300 |
e-societyrobot
synthesio
synthesio crawler release monalisa (contact at synthesio dot fr)
proximic
freefind
dblbot
seznambot
caliperbot
mj12bot
spbot
simplepie
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
sentibot
sentibot www.sentibot.eu (compatible with googlebot)
omgili/0.5 +http://omgili.com
mediatoolkitbot (complaints@mediatoolkit.com)
mozilla/5.0 (compatible; grapeshotcrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
omgili/0.5 +http://omgili.com
musobot
bingbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | /ads.txt |
| Disallow | /ads |
Comments