philmug.ph
robots.txt
Robots Exclusion Standard data for philmug.ph
Resource Scan
Scan Details
| Site Domain | philmug.ph |
| Base Domain | philmug.ph |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-05T02:59:04+00:00 |
| Next Scan | 2025-05-04T02:59:04+00:00 |
Last Successful Scan
| Scanned | 2025-01-05T02:57:12+00:00 |
| URL | https://philmug.ph/robots.txt |
| Domain IPs | 104.21.29.47, 172.67.171.102, 2606:4700:3033::6815:1d2f, 2606:4700:3036::ac43:ab66 |
| Response IP | 172.67.171.102 |
| Found | Yes |
| Hash | d1eaa885b707adda72ef68e5b97493499827fa36c4b9ca9ffcf3461da6944396 |
| SimHash | 0d13dcc25752 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /community/find-new/ |
| Disallow | /community/account/ |
| Disallow | /community/attachments/ |
| Disallow | /community/goto/ |
| Disallow | /community/register/ |
| Disallow | /community/posts/ |
| Disallow | /community/login/ |
| Disallow | /community/admin.php |
| Disallow | /community/misc/contact/ |
| Disallow | /community/conversations/ |
| Disallow | /community/events/birthdays/ |
| Disallow | /community/events/monthly/ |
| Disallow | /community/events/weekly/ |
| Disallow | /community/find-new/ |
| Disallow | /community/help/ |
| Disallow | /community/search/ |
| Disallow | /community/login/ |
| Disallow | /community/members/ |
| Disallow | /community/recent-activity/ |
| Disallow | /community/lost-password/ |
| Disallow | /community/online/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.philmug.ph/community/sitemap.xml.gz |
Comments