gptonline.ai
robots.txt
Robots Exclusion Standard data for gptonline.ai
Resource Scan
Scan Details
| Site Domain | gptonline.ai |
| Base Domain | gptonline.ai |
| Scan Status | Ok |
| Last Scan | 2024-10-02T20:20:27+00:00 |
| Next Scan | 2024-10-09T20:20:27+00:00 |
Last Scan
| Scanned | 2024-10-02T20:20:27+00:00 |
| URL | https://gptonline.ai/robots.txt |
| Domain IPs | 104.21.29.148, 172.67.149.102, 2606:4700:3037::6815:1d94, 2606:4700:3037::ac43:9566 |
| Response IP | 172.67.149.102 |
| Found | Yes |
| Hash | 027c23353a1fd888f9d0e82b7ca4b8cc8e01ce470aea342bd0195af42b22d233 |
| SimHash | a9245d8fa692 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /?ref= |
| Disallow | /?source= |
| Disallow | /?glang= |
| Disallow | /tag/ |
| Disallow | /search/ |
| Disallow | /?s= |
| Disallow | /?__hstc= |
| Disallow | /p%3D* |
| Disallow | /comment-page |
| Disallow | /*comment-page* |
| Disallow | /component/* |
| Disallow | /wp-login.php* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gptonline.ai/sitemap_index.xml |