media.info
robots.txt
Robots Exclusion Standard data for media.info
Resource Scan
Scan Details
| Site Domain | media.info |
| Base Domain | media.info |
| Scan Status | Ok |
| Last Scan | 2024-09-23T14:06:43+00:00 |
| Next Scan | 2024-09-30T14:06:43+00:00 |
Last Scan
| Scanned | 2024-09-23T14:06:43+00:00 |
| URL | https://media.info/robots.txt |
| Domain IPs | 18.161.97.114, 18.161.97.118, 18.161.97.76, 18.161.97.94, 2600:9000:21f8:1400:5:439a:2980:93a1, 2600:9000:21f8:4c00:5:439a:2980:93a1, 2600:9000:21f8:5a00:5:439a:2980:93a1, 2600:9000:21f8:600:5:439a:2980:93a1, 2600:9000:21f8:6400:5:439a:2980:93a1, 2600:9000:21f8:6800:5:439a:2980:93a1, 2600:9000:21f8:a600:5:439a:2980:93a1, 2600:9000:21f8:e00:5:439a:2980:93a1 |
| Response IP | 18.165.140.113 |
| Found | Yes |
| Hash | 45e1d7cf8981425c48cb63bcfd8f5a16725a900ae06f1c745f831211e12dbf6a |
| SimHash | 8520de000913 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /edit |
| Disallow | /admin |
| Disallow | /login |
| Disallow | /register |
| Disallow | /1002978 |
| Disallow | /changelog |
| Disallow | */changelog |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://media.info/_sitemaps/index.php |
| sitemap | https://media.info/_sitemaps/articles.php |
| sitemap | https://media.info/_sitemaps/people.php |
| sitemap | https://media.info/_sitemaps/jobs.php |