adyen.com
robots.txt

Robots Exclusion Standard data for adyen.com

Resource Scan

Scan Details

Site Domain adyen.com
Base Domain adyen.com
Scan Status Ok
Last Scan2024-04-24T13:57:30+00:00
Next Scan 2024-05-08T13:57:30+00:00

Last Scan

Scanned2024-04-24T13:57:30+00:00
URL https://adyen.com/robots.txt
Redirect https://www.adyen.com/robots.txt
Redirect Domain www.adyen.com
Redirect Base adyen.com
Domain IPs 15.197.167.90, 3.33.186.135
Redirect IPs 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e202::1f4
Response IP 13.215.246.123
Found Yes
Hash 32a1766b3eb6a599991477a6c91fa6be1a03694f5a3ffedaa8d866d013446bba
SimHash a81104c39352

Groups

infonl_smartling_html_context_crawler

Rule Path
Allow /

algolia_crawler

Rule Path
Allow /

*

Rule Path
Disallow /magnoliaAuthor/
Disallow /members/
Disallow /member-centre/
Disallow /*.asp
Disallow /pdf/
Disallow /dms/
Disallow /PD/

Other Records

Field Value
sitemap https://www.adyen.com/sitemap.xml