bestraid.ga
robots.txt
Robots Exclusion Standard data for bestraid.ga
Resource Scan
Scan Details
Site Domain | bestraid.ga |
Base Domain | bestraid.ga |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-06-24T02:20:23+00:00 |
Next Scan | 2025-09-22T02:20:23+00:00 |
Last Successful Scan
Scanned | 2023-05-09T11:05:23+00:00 |
URL | https://bestraid.ga/robots.txt |
Domain IPs | 104.21.46.185, 172.67.141.97, 2606:4700:3033::ac43:8d61, 2606:4700:3037::6815:2eb9 |
Response IP | 172.67.141.97 |
Found | Yes |
Hash | c01fea91037358771734f05ddcbdac184a6f1542db73efee62e00245b9c327ed |
SimHash | 61d4d7767bb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp |
Disallow | /tag |
Disallow | /rss |
Disallow | /search |
Disallow | /category |
Disallow | /xfsearch |
Disallow | /wordpress |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |