rev.com
robots.txt
Robots Exclusion Standard data for rev.com
Resource Scan
Scan Details
Site Domain | rev.com |
Base Domain | rev.com |
Scan Status | Ok |
Last Scan | 2024-10-22T10:57:29+00:00 |
Next Scan | 2024-11-05T10:57:29+00:00 |
Last Scan
Scanned | 2024-10-22T10:57:29+00:00 |
URL | https://rev.com/robots.txt |
Redirect | https://www.rev.com/robots.txt |
Redirect Domain | www.rev.com |
Redirect Base | rev.com |
Domain IPs | 100.20.78.130, 34.208.102.24, 52.89.252.110, 54.69.17.112 |
Redirect IPs | 18.161.97.124, 18.161.97.20, 18.161.97.85, 18.161.97.99 |
Response IP | 65.9.112.99 |
Found | Yes |
Hash | 9a781e9797229877f1a982b39e0d913f237cd7b286de50adf4b6f1841320035f |
SimHash | 5845d0904b12 |
Groups
*
Rule | Path |
---|---|
Disallow | /captions-editor/ |
Disallow | /tc-editor/ |
Disallow | /transcript-editor/ |
Disallow | /blog/wp-content/plugins/ |
Disallow | /blog/wp-admin/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rev.com/sitemap.xml |
sitemap | https://www.rev.com/blog/sitemap_index.xml |
sitemap | https://www.rev.com/blog/sitemap-news.xml |
Warnings
- `noindex` is not a known field.