unternehmensauskunft.com
robots.txt

Robots Exclusion Standard data for unternehmensauskunft.com

Resource Scan

Scan Details

Site Domain unternehmensauskunft.com
Base Domain unternehmensauskunft.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-26T15:37:51+00:00
Next Scan 2024-11-24T15:37:51+00:00

Last Successful Scan

Scanned2023-02-04T09:15:08+00:00
URL https://unternehmensauskunft.com/robots.txt
Redirect https://www.unternehmensauskunft.com/robots.txt
Redirect Domain www.unternehmensauskunft.com
Redirect Base unternehmensauskunft.com
Domain IPs 104.21.91.170, 172.67.175.207, 2606:4700:3030::6815:5baa, 2606:4700:3031::ac43:afcf
Redirect IPs 104.21.91.170, 172.67.175.207, 2606:4700:3030::6815:5baa, 2606:4700:3031::ac43:afcf
Response IP 104.21.91.170
Found Yes
Hash 680ca32416efc917a59b163a8838a634cef1b6fee672b374fc3fe1066a39b12d
SimHash 31cd4c695891

Groups

wget<br />
webzip<br />
unisterbot<br />
suggybot<br />
baiduspider<br />
yandex<br />
blexbot<br />
proximic<br />
exabot<br />
yodaobot<br />
wiederfreibot<br />
semrushbot<br />

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.unternehmensauskunft.com/sitemaps/4/sitemap-index.xml

Warnings

  • 15 invalid lines.