studyib.net
robots.txt
Robots Exclusion Standard data for studyib.net
Resource Scan
Scan Details
| Site Domain | studyib.net |
| Base Domain | studyib.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-08-02T16:35:53+00:00 |
| Next Scan | 2025-10-31T16:35:53+00:00 |
Last Successful Scan
| Scanned | 2025-03-13T16:30:39+00:00 |
| URL | https://studyib.net/robots.txt |
| Domain IPs | 104.21.80.187, 172.67.153.32, 2606:4700:3031::6815:50bb, 2606:4700:3034::ac43:9920 |
| Response IP | 172.67.153.32 |
| Found | Yes |
| Hash | f39d842a5099735a75ea62f3c99b40443df65985935822bfed92882d2eb77155 |
| SimHash | 1004d9d64236 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cache/ |
| Disallow | /css/ |
| Disallow | /error/ |
| Disallow | /js/ |
| Disallow | /pages/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://studyib.net/sitemap.xml |
| sitemap | https://studyib.net/sitemap.xml |
| sitemap | https://studyib.net/sitemap.xml |