bigboost.com
robots.txt
Robots Exclusion Standard data for bigboost.com
Resource Scan
Scan Details
| Site Domain | bigboost.com |
| Base Domain | bigboost.com |
| Scan Status | Ok |
| Last Scan | 2024-09-11T14:53:26+00:00 |
| Next Scan | 2024-09-25T14:53:26+00:00 |
Last Scan
| Scanned | 2024-09-11T14:53:26+00:00 |
| URL | https://bigboost.com/robots.txt |
| Domain IPs | 108.156.133.125, 108.156.133.126, 108.156.133.30, 108.156.133.70 |
| Response IP | 108.156.133.30 |
| Found | Yes |
| Hash | 0f3de798e087ac791871708f8bbab031299e13a79d8374b4c2309205c8de352d |
| SimHash | 691491608991 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?login=* |
| Disallow | /*%26login%3D* |
| Disallow | /*?terms=* |
| Disallow | /*%26terms%3D* |
| Disallow | /*?privacy=* |
| Disallow | /*%26privacy%3D* |
| Disallow | /*?bonus=* |
| Disallow | /*%26bonus%3D* |
| Disallow | /*%26promotions%3D* |
| Disallow | /*/faq* |
| Disallow | /*/register* |
| Disallow | /*%26btag%3D* |
| Disallow | /*?btag=* |
| Disallow | /*?bid=* |
| Disallow | /*%26bid%3D* |
| Disallow | /*?etag=* |
| Disallow | /*%26etag%3D* |
| Disallow | /*?utm_source=* |
| Disallow | /*%26utm_source%3D* |
| Disallow | /index.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bigboost.com/sitemap.xml |