goal-arab.cc
robots.txt
Robots Exclusion Standard data for goal-arab.cc
Resource Scan
Scan Details
| Site Domain | goal-arab.cc |
| Base Domain | goal-arab.cc |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-10-19T16:56:24+00:00 |
| Next Scan | 2025-10-26T16:56:24+00:00 |
Last Successful Scan
| Scanned | 2025-09-18T16:31:13+00:00 |
| URL | https://goal-arab.cc/robots.txt |
| Redirect | https://www.goal-arab.cc/robots.txt |
| Redirect Domain | www.goal-arab.cc |
| Redirect Base | goal-arab.cc |
| Domain IPs | 104.21.4.167, 172.67.132.70, 2606:4700:3031::6815:4a7, 2606:4700:3031::ac43:8446 |
| Redirect IPs | 104.21.4.167, 172.67.132.70, 2606:4700:3031::6815:4a7, 2606:4700:3031::ac43:8446 |
| Response IP | 172.67.132.70 |
| Found | Yes |
| Hash | 973aed63fa6983600f565b250e6c2bc048bba7005acad9f70ddf4b05738f58b1 |
| SimHash | 681954c08f51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /p/ |
| Disallow | /index/ |
| Disallow | /player.php |
| Disallow | /embed.php |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.goal-arab.cc/sitemaps.xml |