bachthien.com
robots.txt

Robots Exclusion Standard data for bachthien.com

Resource Scan

Scan Details

Site Domain bachthien.com
Base Domain bachthien.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-04T23:21:18+00:00
Next Scan 2024-12-03T23:21:18+00:00

Last Successful Scan

Scanned2024-02-08T23:05:39+00:00
URL https://bachthien.com/robots.txt
Redirect https://www.bachthien.com/robots.txt
Redirect Domain www.bachthien.com
Redirect Base bachthien.com
Domain IPs 104.21.37.243, 172.67.216.108, 2606:4700:3030::6815:25f3, 2606:4700:3033::ac43:d86c
Redirect IPs 104.21.37.243, 172.67.216.108, 2606:4700:3030::6815:25f3, 2606:4700:3033::ac43:d86c
Response IP 172.67.216.108
Found Yes
Hash 1041b299ef05f06c32ba790875facaa71e9b78348957b1ffeb801fc0e8f07866
SimHash ed295c4cc3f3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-login.php

Other Records

Field Value
crawl-delay 5