arenapile.com
robots.txt
Robots Exclusion Standard data for arenapile.com
Resource Scan
Scan Details
| Site Domain | arenapile.com |
| Base Domain | arenapile.com |
| Scan Status | Ok |
| Last Scan | 2025-04-01T04:33:50+00:00 |
| Next Scan | 2025-04-08T04:33:50+00:00 |
Last Scan
| Scanned | 2025-04-01T04:33:50+00:00 |
| URL | https://arenapile.com/robots.txt |
| Redirect | https://www.arenapile.com/robots.txt |
| Redirect Domain | www.arenapile.com |
| Redirect Base | arenapile.com |
| Domain IPs | 2a02:4780:84:e7ef:5ef9:c881:38e1:6185, 93.127.187.164 |
| Redirect IPs | 2a02:4780:84:1c3c:5a05:e0f8:d1d6:3ee3, 77.37.48.1 |
| Response IP | 93.127.196.182 |
| Found | Yes |
| Hash | 512e50e3979e04dc5f7298fb0487ca780b09587201d72328652d32b7aa48af0a |
| SimHash | 483e5d01a6a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Disallow | /*.htm$ |
| Disallow | /*.html$ |
| Disallow | /tag/ |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
googlebot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
bingbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
oai searchbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
gptbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.arenapile.com/sitemap.xml |
Comments