internationalpayments.com
robots.txt
Robots Exclusion Standard data for internationalpayments.com
Resource Scan
Scan Details
Site Domain | internationalpayments.com |
Base Domain | internationalpayments.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-02-20T16:05:00+00:00 |
Next Scan | 2024-05-20T16:05:00+00:00 |
Last Successful Scan
Scanned | 2023-07-03T12:29:00+00:00 |
URL | http://internationalpayments.com/robots.txt |
Redirect | http://www.travelexbusiness.com/robots.txt |
Redirect Domain | www.travelexbusiness.com |
Redirect Base | travelexbusiness.com |
Domain IPs | 96.45.82.135, 96.45.82.70, 96.45.83.180, 96.45.83.52 |
Redirect IPs | 199.59.243.223 |
Response IP | 199.59.243.223 |
Found | Yes |
Hash | 560266c9f70e4d1d8349691716a0608aa35f98e85232fef4c10063e0c41246ba |
SimHash | 2d0ada6082f3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?* |
Disallow | /_zc |
Disallow | /terms |
Disallow | /privacy |
Other Records
Field | Value |
---|---|
crawl-delay | 120 |