airwallex.com
robots.txt

Robots Exclusion Standard data for airwallex.com

Resource Scan

Scan Details

Site Domain airwallex.com
Base Domain airwallex.com
Scan Status Ok
Last Scan2024-06-29T09:53:28+00:00
Next Scan 2024-07-13T09:53:28+00:00

Last Scan

Scanned2024-06-29T09:53:28+00:00
URL https://airwallex.com/robots.txt
Redirect https://www.airwallex.com:443/robots.txt
Redirect Domain www.airwallex.com
Redirect Base airwallex.com
Domain IPs 34.102.197.111
Redirect IPs 104.16.81.59, 104.16.82.59, 2606:4700::6810:513b, 2606:4700::6810:523b
Response IP 104.16.81.59
Found Yes
Hash 36fef979c2439cb538c02c3dd0cba85a12b329320fa8ec95fba01f95a5e9cc50
SimHash 2b5105d3cef3

Groups

high-fx-fees

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /shopifyapp
Disallow /app/
Disallow /app1/
Disallow /webapp/fraud/

archive.org_bot

Rule Path
Disallow /shopifyapp
Disallow /app/
Disallow /app1/
Disallow /webapp/fraud/

ia_archiver-web.archive.org

Rule Path
Disallow /shopifyapp
Disallow /app/
Disallow /app1/
Disallow /webapp/fraud/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.airwallex.com/sitemap-index.xml

Comments

  • High FX fees for business are not allowed
  • archive.org
  • Default