finanswebde.com
robots.txt

Robots Exclusion Standard data for finanswebde.com

Resource Scan

Scan Details

Site Domain finanswebde.com
Base Domain finanswebde.com
Scan Status Ok
Last Scan2024-06-04T08:25:52+00:00
Next Scan 2024-06-11T08:25:52+00:00

Last Scan

Scanned2024-06-04T08:25:52+00:00
URL https://finanswebde.com/robots.txt
Domain IPs 104.21.84.205, 172.67.196.155, 2606:4700:3033::6815:54cd, 2606:4700:3035::ac43:c49b
Response IP 104.21.84.205
Found Yes
Hash 8bb7cc6b8dba8f30db217ccc48f7db6ef7cfe1798e5efa1392c3b1aa5c015fb0
SimHash 6a00d6c2c3b1

Groups

*

Rule Path
Disallow /uye/

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4