tapas.io
robots.txt
Robots Exclusion Standard data for tapas.io
Resource Scan
Scan Details
| Site Domain | tapas.io |
| Base Domain | tapas.io |
| Scan Status | Ok |
| Last Scan | 2025-11-08T13:51:43+00:00 |
| Next Scan | 2025-11-15T13:51:43+00:00 |
Last Scan
| Scanned | 2025-11-08T13:51:43+00:00 |
| URL | https://tapas.io/robots.txt |
| Domain IPs | 44.238.220.109, 54.189.2.88 |
| Response IP | 54.189.2.88 |
| Found | Yes |
| Hash | 1928fea093c463541a677fe3e25dae5d4ba23e5800c09b64454f7a754c958e66 |
| SimHash | 4037df104655 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /report/ |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
bingbot
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
twitterbot
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
mediapartners-google
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
slurp
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
yandex
| Rule | Path |
|---|---|
| Disallow | /mature |
| Disallow | /profile/ |
| Disallow | /dashboard/ |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
msnbot
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
baiduspider
| Rule | Path |
|---|---|
| Allow | /series/ |
| Allow | /episode/ |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /mature |
| Disallow | /profile |
| Disallow | /dashboard |
| Disallow | /activities |
| Disallow | /rss/ |
| Disallow | /*/disabled |
| Disallow | /series/*/disabled |
| Disallow | /account/ |
| Disallow | /anon.* |
| Disallow | /search |
| Disallow | */subscribers |
| Disallow | */tippers |
| Disallow | */reading-list |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tapas.io/sitemap.xml |