ph4.ru
robots.txt
Robots Exclusion Standard data for ph4.ru
Resource Scan
Scan Details
Site Domain | ph4.ru |
Base Domain | ph4.ru |
Scan Status | Ok |
Last Scan | 2024-09-24T21:04:50+00:00 |
Next Scan | 2024-10-01T21:04:50+00:00 |
Last Scan
Scanned | 2024-09-24T21:04:50+00:00 |
URL | https://ph4.ru/robots.txt |
Redirect | https://www.ph4.ru/robots.txt |
Redirect Domain | www.ph4.ru |
Redirect Base | ph4.ru |
Domain IPs | 2001:1bb0:e000:1e::2ae, 217.107.219.103 |
Redirect IPs | 2001:1bb0:e000:1e::2ae, 217.107.219.103 |
Response IP | 217.107.219.103 |
Found | Yes |
Hash | 11ef39ab938d89a28ca9cf2664b84499fd26f7e6d163cd354beb7486ac58a804 |
SimHash | d4f81f345089 |
Groups
*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
yandex
yandexbot
yandexmedia
yandeximages
yandexblogs
yandexnews
yandexmetrika
Rule | Path |
---|---|
Disallow | /assets/ |
Disallow | /css/ |
Disallow | /DL/ |
Disallow | /images/ |
Disallow | /img_logo/ |
Disallow | /inc/ |
Disallow | /inc2/ |
Disallow | /informer/ |
Disallow | /js/ |
Disallow | /pics/ |
Disallow | /qb/ |
Disallow | /txt/ |
Disallow | /unitegallery/ |
Disallow | /wallpaper/ |
Disallow | /0.php |
Disallow | /__z.php |
Disallow | /__dl.php |
Disallow | /__cookie-wp.php |
Disallow | /__cookie-font2.php |
Disallow | /__cookie-font.php |
Disallow | /__cookie-counter.php |
Disallow | /__cookie-beatles.php |
Disallow | /__cookie-b.php |
Disallow | /__cookie-all.php |
Disallow | /__4abbr.php |
Disallow | /__calendar.php |
Disallow | /__counter.php |
Disallow | /__qr.php |
Disallow | /__cookie-mode.php |
Disallow | /1000words.php |
Disallow | /_dl.php |
Disallow | /_p_tune.php |
Disallow | /abmail.php |
Disallow | /aboutarticle.php |
Disallow | /apdates.php |
Disallow | /asearch.php |
Disallow | /audiobible.php |
Disallow | /bq_bqhotley.php |
Disallow | /calendar.php |
Disallow | /cookie-all.php |
Disallow | /cookie-b.php |
Disallow | /cookie-beatles.php |
Disallow | /cookie-font.php |
Disallow | /cookie-wp.php |
Disallow | /cookies.php |
Disallow | /dom_url.php |
Disallow | /fontgen.php |
Disallow | /gohome.php |
Disallow | /grafikasmiles.php |
Disallow | /irreg.php |
Disallow | /player.php |
Disallow | /poisk.php |
Disallow | /qr.php |
Disallow | /r.php |
Disallow | /random.php |
Disallow | /random2.php |
Disallow | /vauto2.php |
Disallow | /vavia2.php |
Disallow | /vcard.php |
Disallow | /vtransport2.php |
Disallow | /wallpaper.php |
Disallow | /whois.php |
Disallow | /x.php |
Disallow | /xgrafa.php |
Disallow | /xgrafanim.php |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ph4.ru/sitemap.xml |
sitemap | https://www.ph4.ru/sitemap.xml.gz |
Warnings
- `host` is not a known field.