deepsource.com
robots.txt
Robots Exclusion Standard data for deepsource.com
Resource Scan
Scan Details
| Site Domain | deepsource.com |
| Base Domain | deepsource.com |
| Scan Status | Ok |
| Last Scan | 2024-09-13T23:55:57+00:00 |
| Next Scan | 2024-09-27T23:55:57+00:00 |
Last Scan
| Scanned | 2024-09-13T23:55:57+00:00 |
| URL | https://deepsource.com/robots.txt |
| Domain IPs | 13.200.123.229, 13.234.100.116, 65.0.79.182 |
| Response IP | 65.0.79.182 |
| Found | Yes |
| Hash | 06eb064bd6f0beb9d1799c870569d0f7183def87d1eb63a6ae8470b19ee398b0 |
| SimHash | 692c0d45c015 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /services |
| Disallow | /lp/* |
| Disallow | /callback/* |
| Disallow | /control-panel/* |
| Disallow | /report/* |
| Disallow | /health/* |
| Disallow | /request-pilot-license/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://deepsource.com/sitemap.xml |