astralgossip.com
robots.txt
Robots Exclusion Standard data for astralgossip.com
Resource Scan
Scan Details
| Site Domain | astralgossip.com |
| Base Domain | astralgossip.com |
| Scan Status | Ok |
| Last Scan | 2024-09-30T07:00:19+00:00 |
| Next Scan | 2024-10-07T07:00:19+00:00 |
Last Scan
| Scanned | 2024-09-30T07:00:19+00:00 |
| URL | https://astralgossip.com/robots.txt |
| Domain IPs | 104.21.86.87, 172.67.217.48, 2606:4700:3033::6815:5657, 2606:4700:3035::ac43:d930 |
| Response IP | 172.67.217.48 |
| Found | Yes |
| Hash | 14a9f558ab638b9e79310ea0f731ca9efc111b01167c08256a76da0c707e7939 |
| SimHash | 2f1d9904c391 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /?attachment_id |
| Disallow | /attachment/ |
| Disallow | /attachment/* |
| Disallow | /members/ |
| Disallow | /membros/ |
| Disallow | /readme.html |
| Disallow | /refer/ |
| Disallow | /page/ |
| Disallow | /page/* |
| Disallow | /undefined/* |
| Disallow | /undefined/ |
| Disallow | /*.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://astralgossip.com/sitemap_index.xml |
Comments