dev-submittable.com
robots.txt
Robots Exclusion Standard data for dev-submittable.com
Resource Scan
Scan Details
Site Domain | dev-submittable.com |
Base Domain | dev-submittable.com |
Scan Status | Ok |
Last Scan | 2025-09-22T05:51:26+00:00 |
Next Scan | 2025-10-06T05:51:26+00:00 |
Last Scan
Scanned | 2025-09-22T05:51:26+00:00 |
URL | https://www.dev-submittable.com/robots.txt |
Domain IPs | 23.54.118.41, 23.54.118.46, 2600:1413:5000:12::1737:27e5, 2600:1413:5000:12::1737:27f0 |
Response IP | 23.55.44.136 |
Found | Yes |
Hash | c14f7229084dcd056363a23acca25405c12b6558705ceaa5e1b4183aef49f3d8 |
SimHash | e832d9bb42f4 |
Groups
*
Product | Comment |
---|---|
* | any robot |
Rule | Path |
---|---|
Disallow | /user/ |
Disallow | /settings/ |
Disallow | /account/ |
Disallow | /payment/ |
Disallow | /paypal/ |
Disallow | /signup/submission/* |
Disallow | /signup/resume/* |
Disallow | /Account/ |
Disallow | /Publisher/StaffAccept/ |
Disallow | /StaffAccept/ |
Disallow | /SubmissionEdit/ |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | number of seconds to wait between subsequent visits |
Comments