afterpay.com
robots.txt

Robots Exclusion Standard data for afterpay.com

Resource Scan

Scan Details

Site Domain afterpay.com
Base Domain afterpay.com
Scan Status Ok
Last Scan2026-01-18T21:38:55+00:00
Next Scan 2026-01-25T21:38:55+00:00

Last Scan

Scanned2026-01-18T21:38:55+00:00
URL https://afterpay.com/robots.txt
Redirect https://www.afterpay.com/robots.txt
Redirect Domain www.afterpay.com
Redirect Base afterpay.com
Domain IPs 104.16.223.179, 104.19.176.211, 2606:4700::6810:dfb3, 2606:4700::6813:b0d3
Redirect IPs 104.16.223.179, 104.19.176.211, 2606:4700::6810:dfb3, 2606:4700::6813:b0d3
Response IP 104.16.223.179
Found Yes
Hash c13f65b7b4092a73662d02ada25991981228f541f1a3517ea8faf03c54451179
SimHash a9644b58c213

Groups

*

Rule Path Comment
Disallow %5E$ noindex www.afterpay.com
Disallow /$ noindex www.afterpay.com/
Disallow /builder/ -
Disallow /site-staging/ -
Allow / -

Other Records

Field Value
sitemap https://www.afterpay.com/sitemap.xml

Comments

  • Disallow crawling of the builder pages