marvelapp.com
robots.txt
Robots Exclusion Standard data for marvelapp.com
Resource Scan
Scan Details
| Site Domain | marvelapp.com |
| Base Domain | marvelapp.com |
| Scan Status | Ok |
| Last Scan | 2024-10-22T05:03:16+00:00 |
| Next Scan | 2024-11-21T05:03:16+00:00 |
Last Scan
| Scanned | 2024-10-22T05:03:16+00:00 |
| URL | https://marvelapp.com/robots.txt |
| Domain IPs | 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217, 2a04:4e42:200::729, 2a04:4e42:400::729, 2a04:4e42:600::729, 2a04:4e42::729 |
| Response IP | 151.101.130.217 |
| Found | Yes |
| Hash | f0210cb7017e8e63de3b12826451170ec6e9a41471457c667b0a0dd9edd58376 |
| SimHash | e9098e424f30 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /pop/?popref=1 |
| Disallow | /*?* |
| Disallow | /dashboard/ |
| Disallow | /project/ |
| Disallow | /viewp/ |
| Disallow | /home |
| Disallow | /graphql |
| Disallow | /oauth/* |
| Disallow | /build/* |
| Disallow | /profile/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://marvelapp.com/sitemap.xml |
| sitemap | https://marvelapp.com/blog/sitemap_index.xml |