msplus168.com
robots.txt

Robots Exclusion Standard data for msplus168.com

Resource Scan

Scan Details

Site Domain msplus168.com
Base Domain msplus168.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-27T00:51:18+00:00
Next Scan 2025-07-26T00:51:18+00:00

Last Successful Scan

Scanned2024-12-05T23:42:31+00:00
URL https://msplus168.com/robots.txt
Redirect https://www.msplus168.com/robots.txt
Redirect Domain www.msplus168.com
Redirect Base msplus168.com
Domain IPs 104.21.47.119, 172.67.171.34, 2606:4700:3033::6815:2f77, 2606:4700:3036::ac43:ab22
Redirect IPs 104.21.47.119, 172.67.171.34, 2606:4700:3033::6815:2f77, 2606:4700:3036::ac43:ab22
Response IP 172.67.171.34
Found Yes
Hash 8ca959ca1d66b334b6202bb7e1fac91cc56a0aa19d1aedd361d6a7e99f0a0dff
SimHash ea3cd860eb33

Groups

ahrefsbot

Rule Path
Disallow /blog/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /blog/*

Other Records

Field Value
crawl-delay 5