minitoolai.com
robots.txt
Robots Exclusion Standard data for minitoolai.com
Resource Scan
Scan Details
| Site Domain | minitoolai.com |
| Base Domain | minitoolai.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-18T11:09:18+00:00 |
| Next Scan | 2025-11-01T11:09:18+00:00 |
Last Successful Scan
| Scanned | 2025-10-03T10:52:51+00:00 |
| URL | https://minitoolai.com/robots.txt |
| Domain IPs | 104.21.19.67, 172.67.185.151, 2606:4700:3033::ac43:b997, 2606:4700:3036::6815:1343 |
| Response IP | 104.21.19.67 |
| Found | Yes |
| Hash | 8b83a5a384aadf6b58edebfb360e6c59bcb2d10ebdaf55e13c61342dc406b03d |
| SimHash | 4116f6855751 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /img_* |
| Disallow | /reading_* |
| Disallow | /ytb_* |
| Disallow | /chat_a* |
| Disallow | /chat_a*.php |
| Disallow | /pay* |
| Disallow | /binance* |
| Disallow | /bsc_* |
| Disallow | /ad_*.php |
| Disallow | /igv* |
| Disallow | /image_generator_dall* |
| Disallow | /*_key.php |
| Disallow | /*_Com.html |
| Disallow | /*upload/* |
| Disallow | /mail. |
| Disallow | /mail.* |
| Disallow | /chat-pdf/upload/ |
| Disallow | /api/ |
| Disallow | /chatGPT/?convo_id=* |
| Disallow | /chatGPT/?convo_id= |
| Disallow | /chat-pdf/?pdf_id=* |
| Disallow | /chat-pdf/?pdf_id= |
| Disallow | /users/?username=* |
| Disallow | /users/?username= |
| Disallow | /users/?u=* |
| Disallow | /users/?u= |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://minitoolai.com/sitemap.xml |