ph4.org
robots.txt
Robots Exclusion Standard data for ph4.org
Resource Scan
Scan Details
Site Domain | ph4.org |
Base Domain | ph4.org |
Scan Status | Ok |
Last Scan | 2024-09-29T18:56:06+00:00 |
Next Scan | 2024-10-06T18:56:06+00:00 |
Last Scan
Scanned | 2024-09-29T18:56:06+00:00 |
URL | https://ph4.org/robots.txt |
Redirect | https://www.ph4.org/robots.txt |
Redirect Domain | www.ph4.org |
Redirect Base | ph4.org |
Domain IPs | 2001:1bb0:e000:1e::2ae, 217.107.219.103 |
Redirect IPs | 2001:1bb0:e000:1e::2ae, 217.107.219.103 |
Response IP | 217.107.219.103 |
Found | Yes |
Hash | 594182c7e11cab0433ca7d486787dec32d0e3e26d411f9801e8a90f83fca7d72 |
SimHash | 63e817245039 |
Groups
*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile
yandex
yandexbot
yandexmedia
yandeximages
yandexblogs
yandexnews
yandexmetrika
Rule | Path |
---|---|
Disallow | /_RU |
Disallow | /assets/ |
Disallow | /images/ |
Disallow | /inc/ |
Disallow | /inc2/ |
Disallow | /informer/ |
Disallow | /TXT/ |
Disallow | /0.php |
Disallow | /__z.php |
Disallow | /__dl.php |
Disallow | /__cookie-wp.php |
Disallow | /__cookie-font2.php |
Disallow | /__cookie-font.php |
Disallow | /__cookie-counter.php |
Disallow | /__cookie-beatles.php |
Disallow | /__cookie-b.php |
Disallow | /__cookie-all.php |
Disallow | /__4abbr.php |
Disallow | /__calendar.php |
Disallow | /__counter.php |
Disallow | /__qr.php |
Disallow | /__cookie-mode.php |
Disallow | /1000words.php |
Disallow | /_dl.php |
Disallow | /_p_tune.php |
Disallow | /abmail.php |
Disallow | /aboutarticle.php |
Disallow | /apdates.php |
Disallow | /asearch.php |
Disallow | /audiobible.php |
Disallow | /bq_bqhotley.php |
Disallow | /calendar.php |
Disallow | /cookie-all.php |
Disallow | /cookie-b.php |
Disallow | /cookie-beatles.php |
Disallow | /cookie-font.php |
Disallow | /cookie-wp.php |
Disallow | /cookies.php |
Disallow | /dom_url.php |
Disallow | /fontgen.php |
Disallow | /gohome.php |
Disallow | /grafikasmiles.php |
Disallow | /irreg.php |
Disallow | /player.php |
Disallow | /poisk.php |
Disallow | /qr.php |
Disallow | /r.php |
Disallow | /random.php |
Disallow | /random2.php |
Disallow | /vauto2.php |
Disallow | /vavia2.php |
Disallow | /vcard.php |
Disallow | /vtransport2.php |
Disallow | /wallpaper.php |
Disallow | /whois.php |
Disallow | /x.php |
Disallow | /xgrafa.php |
Disallow | /xgrafanim.php |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ph4.org/sitemap.xml |
sitemap | https://www.ph4.org/sitemap.xmlgz |
Warnings
- `host` is not a known field.