arvato-systems.de
robots.txt

Robots Exclusion Standard data for arvato-systems.de

Resource Scan

Scan Details

Site Domain arvato-systems.de
Base Domain arvato-systems.de
Scan Status Ok
Last Scan2024-09-22T20:06:13+00:00
Next Scan 2024-10-22T20:06:13+00:00

Last Scan

Scanned2024-09-22T20:06:13+00:00
URL https://arvato-systems.de/robots.txt
Redirect https://www.arvato-systems.de/robots.txt
Redirect Domain www.arvato-systems.de
Redirect Base arvato-systems.de
Domain IPs 146.185.102.71
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash 4fe72bdc4beed81801f9006ee9b70bf1c978a1e24962e15ea55ee14c641852e4
SimHash e84898729733

Groups

*

Rule Path
Allow /
Allow /arvato-systems/*
Disallow /loginpage/
Disallow /bot-traffic.xyz

Other Records

Field Value
sitemap https://www.arvato-systems.de/service-sitemap-7596fa11e6689c5c62cf2d9c603e9986-sitemap_index.xml
sitemap https://www.arvato-systems.com/service-sitemap-0982dc54bdea6560e991be4acfb0f126-sitemap_index.xml
sitemap https://us.arvato-systems.com/service-sitemap-535e6849c862e902c57fc01e37c81d40-sitemap_index.xml