natalie.mu
robots.txt
Robots Exclusion Standard data for natalie.mu
Resource Scan
Scan Details
| Site Domain | natalie.mu |
| Base Domain | natalie.mu |
| Scan Status | Ok |
| Last Scan | 2024-04-27T00:05:19+00:00 |
| Next Scan | 2024-05-04T00:05:19+00:00 |
Last Scan
| Scanned | 2024-04-27T00:05:19+00:00 |
| URL | https://natalie.mu/robots.txt |
| Domain IPs | 18.180.121.241, 54.150.15.147 |
| Response IP | 18.180.121.241 |
| Found | Yes |
| Hash | b68be5c98fb5b067df398f1be633dd8e96b2ea9e4ecf77d0e2734e9996fe049d |
| SimHash | c905ded4c5a3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */gallery/artist/ |
| Disallow | */gallery/film/ |
| Disallow | */gallery/show/ |
| Disallow | */gallery/hot/media/ |
| Disallow | */search |
| Disallow | */hot/update/ |
| Disallow | */cinema/prepare/film_id/ |
| Disallow | */cinema/prefs |
| Disallow | */cinema/areas |
| Disallow | */cinema/schedules/film_id/ |
| Disallow | */go/areas/ |
| Disallow | */go/screens |
| Disallow | */go/film/ |
| Disallow | */go/business_day/ |
| Disallow | */survey |
| Disallow | */ad/tagad/artist/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://natalie.mu/sitemap/all_index |
| sitemap | https://natalie.mu/sitemap/google_news_index |