adyen.link
robots.txt

Robots Exclusion Standard data for adyen.link

Resource Scan

Scan Details

Site Domain adyen.link
Base Domain adyen.link
Scan Status Ok
Last Scan2024-05-06T01:59:47+00:00
Next Scan 2024-05-20T01:59:47+00:00

Last Scan

Scanned2024-05-06T01:59:47+00:00
URL http://adyen.link/robots.txt
Redirect https://www.adyen.com/robots.txt
Redirect Domain www.adyen.com
Redirect Base adyen.com
Domain IPs 185.101.196.80
Redirect IPs 13.215.246.123, 13.215.31.72, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e201::1f4
Response IP 13.215.31.72
Found Yes
Hash 32a1766b3eb6a599991477a6c91fa6be1a03694f5a3ffedaa8d866d013446bba
SimHash a81104c39352

Groups

infonl_smartling_html_context_crawler

Rule Path
Allow /

algolia_crawler

Rule Path
Allow /

*

Rule Path
Disallow /magnoliaAuthor/
Disallow /members/
Disallow /member-centre/
Disallow /*.asp
Disallow /pdf/
Disallow /dms/
Disallow /PD/

Other Records

Field Value
sitemap https://www.adyen.com/sitemap.xml