balatarin.com
robots.txt
Robots Exclusion Standard data for balatarin.com
Resource Scan
Scan Details
| Site Domain | balatarin.com |
| Base Domain | balatarin.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T11:34:44+00:00 |
| Next Scan | 2024-11-20T11:34:44+00:00 |
Last Scan
| Scanned | 2024-11-13T11:34:44+00:00 |
| URL | https://balatarin.com/robots.txt |
| Redirect | https://www.balatarin.com/robots.txt |
| Redirect Domain | www.balatarin.com |
| Redirect Base | balatarin.com |
| Domain IPs | 107.178.241.59, 2600:1901:0:6f1d:: |
| Redirect IPs | 107.178.241.59, 2600:1901:0:6f1d:: |
| Response IP | 107.178.241.59 |
| Found | Yes |
| Hash | e4443ac16d666598825dd8b80c55eb2b60fdb210c290760d2f5c20338ad1f996 |
| SimHash | 4505d274d7d8 |
Groups
slurp
googlebot
msnbot
ia_archiver
twitterbot
facebookexternalhit/1.1
bingbot
duckduckbot
archive.org_bot
| Rule | Path |
|---|---|
| Disallow | /comments/vote/ |
| Disallow | /links/bookmark/ |
| Disallow | /links/upvote/ |
| Disallow | /links/downvote/ |
| Disallow | /links/bookmark/ |
| Disallow | /topics/submit |
| Disallow | /links/submit |
| Disallow | /register |
| Disallow | /account |
| Disallow | /sessions |
| Disallow | /translations |
| Disallow | /users/*/activity |
| Disallow | /pages |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 8 |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://s3.amazonaws.com/bala.static/sitemaps/index.xml.gz |