merb.cc
robots.txt
Robots Exclusion Standard data for merb.cc
Resource Scan
Scan Details
| Site Domain | merb.cc |
| Base Domain | merb.cc |
| Scan Status | Ok |
| Last Scan | 2025-06-11T17:53:39+00:00 |
| Next Scan | 2025-07-11T17:53:39+00:00 |
Last Scan
| Scanned | 2025-06-11T17:53:39+00:00 |
| URL | https://merb.cc/robots.txt |
| Domain IPs | 104.26.8.141, 104.26.9.141, 172.67.72.170, 2606:4700:20::681a:88d, 2606:4700:20::681a:98d, 2606:4700:20::ac43:48aa |
| Response IP | 172.67.72.170 |
| Found | Yes |
| Hash | da081ff571998a2d75d8cddb2709dd82af3f7fd41eb43ce9ccdd27cada997f46 |
| SimHash | f00d2e120913 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /vbulletin/ajax.php |
| Disallow | /vbulletin/attachment.php |
| Disallow | /vbulletin/calendar.php |
| Disallow | /vbulletin/clientscript/ |
| Disallow | /vbulletin/cron.php |
| Disallow | /vbulletin/editpost.php |
| Disallow | /vbulletin/forumrunner/ |
| Disallow | /vbulletin/global.php |
| Disallow | /vbulletin/image.php |
| Disallow | /vbulletin/inlinemod.php |
| Disallow | /vbulletin/joinrequests.php |
| Disallow | /vbulletin/login.php |
| Disallow | /vbulletin/member.php |
| Disallow | /vbulletin/memberlist.php |
| Disallow | /vbulletin/misc.php |
| Disallow | /vbulletin/moderator.php |
| Disallow | /vbulletin/newattachment.php |
| Disallow | /vbulletin/newreply.php |
| Disallow | /vbulletin/newthread.php |
| Disallow | /vbulletin/online.php |
| Disallow | /vbulletin/poll.php |
| Disallow | /vbulletin/postings.php |
| Disallow | /vbulletin/printthread.php |
| Disallow | /vbulletin/private.php |
| Disallow | /vbulletin/profile.php |
| Disallow | /vbulletin/register.php |
| Disallow | /vbulletin/report.php |
| Disallow | /vbulletin/reputation.php |
| Disallow | /vbulletin/search.php |
| Disallow | /vbulletin/sendmessage.php |
| Disallow | /vbulletin/showgroups.php |
| Disallow | /vbulletin/subscription.php |
| Disallow | /vbulletin/threadrate.php |
| Disallow | /vbulletin/usercp.php |
| Disallow | /vbulletin/usernote.php |
| Disallow | /vbulletin/image.php |
| Disallow | /*.gif$ |
| Disallow | /*.jpg$ |
| Disallow | /*.jpeg$ |
| Disallow | /*.png$ |
| Disallow | /*.js$ |
*
| Rule | Path |
|---|---|
| Allow | /vbulletin/archive/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /vbulletin/showthread.php |
| Disallow | /vbulletin/index.php |
| Disallow | /vbulletin/forumdisplay.php |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| sitemap | /vbulletin/xmlsitemap.php |