prepaidunion.com
robots.txt
Robots Exclusion Standard data for prepaidunion.com
Resource Scan
Scan Details
Site Domain | prepaidunion.com |
Base Domain | prepaidunion.com |
Scan Status | Ok |
Last Scan | 2024-11-15T21:37:26+00:00 |
Next Scan | 2024-12-15T21:37:26+00:00 |
Last Scan
Scanned | 2024-11-15T21:37:26+00:00 |
URL | https://prepaidunion.com/robots.txt |
Redirect | https://www.prepaidunion.com/robots.txt |
Redirect Domain | www.prepaidunion.com |
Redirect Base | prepaidunion.com |
Domain IPs | 185.111.121.112, 2a06:5dc0:3::112 |
Redirect IPs | 185.111.121.112 |
Response IP | 185.111.121.112 |
Found | Yes |
Hash | 20ee7dd86a363662426530568a0bfedbb67b815b01fe39e3a7eda23f7db4e7d1 |
SimHash | 1a5ec567dab1 |
Groups
*
Rule | Path |
---|---|
Disallow | /prepay/* |
Disallow | /de/icepay/* |
Disallow | /en/icepay/* |
Disallow | /es/icepay/* |
Disallow | /fr/icepay/* |
Disallow | /nl/icepay/* |
Disallow | /pl/icepay/* |
Disallow | /tl/icepay/* |
Disallow | /default/icepay/* |
Disallow | /de/adyen/* |
Disallow | /en/adyen/* |
Disallow | /es/adyen/* |
Disallow | /fr/adyen/* |
Disallow | /nl/adyen/* |
Disallow | /pl/adyen/* |
Disallow | /tl/adyen/* |
Disallow | /default/adyen/* |
Disallow | /de/iframe/* |
Disallow | /en/iframe/* |
Disallow | /es/iframe/* |
Disallow | /fr/iframe/* |
Disallow | /nl/iframe/* |
Disallow | /pl/iframe/* |
Disallow | /tl/iframe/* |
Disallow | /default/iframe/* |
Disallow | /en/iframe/* |
Disallow | /default/auth/* |
Disallow | /de/auth/* |
Disallow | /en/auth/* |
Disallow | /es/auth/* |
Disallow | /fr/auth/* |
Disallow | /nl/auth/* |
Disallow | /pl/auth/* |
Disallow | /tl/auth/* |
Disallow | /plugins/* |
Disallow | /maintenance/* |
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
Other Records
Field | Value |
---|---|
sitemap | https://www.prepaidunion.com/sitemap.xml |
Warnings
- 3 invalid lines.