soumyagupta.in
robots.txt
Robots Exclusion Standard data for soumyagupta.in
Resource Scan
Scan Details
| Site Domain | soumyagupta.in |
| Base Domain | soumyagupta.in |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't establish SSL connection. |
| Last Scan | 2025-09-25T23:30:40+00:00 |
| Next Scan | 2025-12-24T23:30:40+00:00 |
Last Successful Scan
| Scanned | 2025-05-22T16:23:52+00:00 |
| URL | https://soumyagupta.in/robots.txt |
| Redirect | https://soumyagupta.in/robots.txt?gi=e8f0658cee9a |
| Domain IPs | 52.0.16.118, 52.1.119.170, 52.1.147.205, 52.1.173.203, 52.4.145.119, 52.4.175.111, 52.4.225.124, 52.4.240.221, 52.4.38.70, 52.5.181.79, 52.6.3.192, 52.6.46.142 |
| Response IP | 52.4.225.124 |
| Found | Yes |
| Hash | 7dfffad56f6ec8dbb421696977b1f547c417cf607f8538284e0c221582c9cee2 |
| SimHash | 69143bc4c772 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | /me/ |
| Disallow | /%40me$ |
| Disallow | /%40me/ |
| Disallow | /*/edit$ |
| Disallow | /*/*/edit$ |
| Disallow | /media/ |
| Disallow | /p/*/share |
| Disallow | /r/ |
| Disallow | /trending |
| Disallow | /search?q$ |
| Disallow | /search?q= |
| Disallow | /*/search?q= |
| Disallow | /*/search/*?q= |
| Disallow | /*/*source%3D |
| Allow | /_/ |
| Allow | /_/api/users/*/meta |
| Allow | /_/api/users/*/profile/stream |
| Allow | /_/api/posts/*/responses |
| Allow | /_/api/posts/*/responsesStream |
| Allow | /_/api/posts/*/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://soumyagupta.in/sitemap/sitemap.xml |