aithor.id
robots.txt
Robots Exclusion Standard data for aithor.id
Resource Scan
Scan Details
| Site Domain | aithor.id |
| Base Domain | aithor.id |
| Scan Status | Ok |
| Last Scan | 2025-11-29T21:46:58+00:00 |
| Next Scan | 2025-12-29T21:46:58+00:00 |
Last Scan
| Scanned | 2025-11-29T21:46:58+00:00 |
| URL | https://aithor.id/robots.txt |
| Redirect | https://aithor.com/robots.txt |
| Redirect Domain | aithor.com |
| Redirect Base | aithor.com |
| Domain IPs | 104.21.43.164, 172.67.181.114, 2606:4700:3032::6815:2ba4, 2606:4700:3032::ac43:b572 |
| Redirect IPs | 104.21.50.70, 172.67.158.118, 2606:4700:3034::ac43:9e76, 2606:4700:3036::6815:3246 |
| Response IP | 172.67.158.118 |
| Found | Yes |
| Hash | 5874598412ba273ec5ea82204271e6b85706db45c96eff392b1c597bbd4a28ab |
| SimHash | 4805dc03cd14 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *?* |
| Disallow | */editor/* |
| Allow | *?page=* |
| Allow | *.jpg |
| Allow | *.jpeg |
| Allow | *.png |
| Allow | *.svg |
| Allow | *.gif |
| Allow | *.webp |
| Allow | *.ico |
| Allow | *.woff |
| Allow | *.js |
| Allow | *.css |
Other Records
| Field | Value |
|---|---|
| sitemap | https://aithor.com/sitemap.xml |