app.deepsource.com
robots.txt
Robots Exclusion Standard data for app.deepsource.com
Resource Scan
Scan Details
Site Domain | app.deepsource.com |
Base Domain | deepsource.com |
Scan Status | Ok |
Last Scan | 2024-09-07T21:15:36+00:00 |
Next Scan | 2024-10-07T21:15:36+00:00 |
Last Scan
Scanned | 2024-09-07T21:15:36+00:00 |
URL | https://app.deepsource.com/robots.txt |
Domain IPs | 104.26.4.129, 104.26.5.129, 172.67.74.108, 2606:4700:20::681a:481, 2606:4700:20::681a:581, 2606:4700:20::ac43:4a6c |
Response IP | 104.26.4.129 |
Found | Yes |
Hash | 40d8d309ab5ae149e43b7fa143a6f917c132a73237d97c3f759c2ef2a83f769d |
SimHash | e93c8d45c315 |
Groups
*
Rule | Path |
---|---|
Disallow | /services |
Disallow | /lp/* |
Disallow | /callback/* |
Disallow | /control-panel/* |
Disallow | /report/* |
Disallow | /health/* |
Disallow | /request-pilot-license/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |