chromeriver.com
robots.txt
Robots Exclusion Standard data for chromeriver.com
Resource Scan
Scan Details
Site Domain | chromeriver.com |
Base Domain | chromeriver.com |
Scan Status | Ok |
Last Scan | 2024-06-29T02:17:10+00:00 |
Next Scan | 2024-07-13T02:17:10+00:00 |
Last Scan
Scanned | 2024-06-29T02:17:10+00:00 |
URL | https://chromeriver.com/robots.txt |
Domain IPs | 52.119.44.14 |
Response IP | 52.119.44.14 |
Found | Yes |
Hash | 1a24adf4bbfec937ab38950646aa85f792c424417b11a34636dd9cae600d3369 |
SimHash | 7401d774bf12 |
Groups
*
Rule | Path |
---|---|
Disallow | /purl.org/dc/elements/1.1/ |
Disallow | /ajax.googleapis.com/ajax/libs/jquery/1.4.4/ |
Disallow | /d3msvfqt040hh.cloudfront.net/ |
Disallow | /expense |
Disallow | /login |
Disallow | /expense/app.jsp?v= |
Disallow | /press |
Disallow | /news |
Disallow | /articles |
Disallow | /careers |
Allow | /media/$ |
Disallow | /media/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.chromeriver.com/sitemap/sitemap.xml |