takefreebonus.com
robots.txt
Robots Exclusion Standard data for takefreebonus.com
Resource Scan
Scan Details
| Site Domain | takefreebonus.com |
| Base Domain | takefreebonus.com |
| Scan Status | Ok |
| Last Scan | 2024-09-29T00:19:33+00:00 |
| Next Scan | 2024-10-06T00:19:33+00:00 |
Last Scan
| Scanned | 2024-09-29T00:19:33+00:00 |
| URL | https://www.takefreebonus.com/robots.txt |
| Domain IPs | 161.35.235.47 |
| Response IP | 161.35.235.47 |
| Found | Yes |
| Hash | 81d5f273e7e049d3bf65b0bc6f86514f39e7ffa98ef5c8e5742fc71c14f0ae44 |
| SimHash | 431ec54366b9 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /go/* |
| Disallow | /ext/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | /*?acpage=* |
| Disallow | /activity/p/ |
| Disallow | /cdn-cgi/ |
| Disallow | /play-now/ |
| Disallow | /members/ |
| Disallow | /search/ |
| Disallow | /?s= |
| Allow | /wp-content/uploads/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.takefreebonus.com/sitemap.xml |
Comments