animegid.online
robots.txt
Robots Exclusion Standard data for animegid.online
Resource Scan
Scan Details
| Site Domain | animegid.online |
| Base Domain | animegid.online |
| Scan Status | Ok |
| Last Scan | 2024-09-21T06:27:30+00:00 |
| Next Scan | 2024-09-28T06:27:30+00:00 |
Last Scan
| Scanned | 2024-09-21T06:27:30+00:00 |
| URL | https://animegid.online/robots.txt |
| Domain IPs | 104.21.65.21, 172.67.139.100, 2606:4700:3030::ac43:8b64, 2606:4700:3035::6815:4115 |
| Response IP | 104.21.65.21 |
| Found | Yes |
| Hash | 8a79ececd6ae88af1f5f2e816c2512253e413211b10c570e6de699d03e6601d3 |
| SimHash | 01918d423eb6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/components/ |
| Disallow | /connectors/ |
| Disallow | /core/ |
| Disallow | /manager/ |
| Disallow | /index.php |
| Disallow | /goo |
| Disallow | *? |
| Allow | /assets/*.jpg |
| Allow | /assets/*.webp |
| Allow | /assets/*.jpeg |
| Allow | /assets/*.gif |
| Allow | /assets/*.png |
| Allow | /assets/*.pdf |
| Allow | /assets/*.doc |
| Allow | /assets/*.docx |
| Allow | /assets/*.xls |
| Allow | /assets/*.xlsx |
| Allow | /assets/*.ppt |
| Allow | /assets/*.pptx |
| Allow | /assets/*.js |
| Allow | /assets/*.css |
Other Records
| Field | Value |
|---|---|
| sitemap | https://animegid.online/sitemap.xml |
Warnings
- `host` is not a known field.