xt.ht
robots.txt

Robots Exclusion Standard data for xt.ht

Resource Scan

Scan Details

Site Domain xt.ht
Base Domain xt.ht
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-09T21:48:44+00:00
Next Scan 2026-04-10T21:48:44+00:00

Last Successful Scan

Scanned2025-12-11T18:25:25+00:00
URL https://xt.ht/robots.txt
Domain IPs 104.21.89.5, 172.67.155.101, 2606:4700:3033::6815:5905, 2606:4700:3033::ac43:9b65
Response IP 104.21.89.5
Found Yes
Hash 05a6469b039ec09c3fa4f186e3c09da571bfe5196b25e9710adaa65dc101942e
SimHash 4d208fd55f1b

Groups

*

Rule Path
Disallow /phpbb/adm/
Disallow /phpbb/faq.php
Disallow /phpbb/mcp.php
Disallow /phpbb/index.php?
Disallow /phpbb/posting.php
Disallow /phpbb/report.php
Allow /phpbb/search.php
Allow /phpbb/style.php
Disallow /phpbb/ucp.php
Disallow /phpbb/viewonline.php
Disallow /phpbb/*%26st%3D*
Disallow /phpbb/*%26sk%3D*
Disallow /phpbb/*%26sd%3D*
Disallow /phpbb/*%26hilit%3D*
Disallow /phpbb/*%26view%3D*
Disallow /phpbb/%21%21%21viewtopic.php*p%3D*
Disallow /phpbb/%21%21%21viewtopic.php?t=*
Allow /phpbb/view*%26start%3D0$
Allow /phpbb/viewtopic.php?p=*
Allow /phpbb/viewtopic.php?f=*&t=*&view=next
Allow /phpbb/viewtopic.php?f=*&t=*&view=previous
Disallow /phpbb/go.php
Disallow /my
Disallow /new
Disallow /banner
Disallow /detectiv
Disallow /pphlogger
Disallow /seo
Allow /?sort_article=2
Allow /?sort_report=2
Allow /?sort_news=2
Disallow /*add_article
Disallow /*add_news
Disallow /*add_report
Disallow /*view%3Dprevious
Disallow /*view%3Dnext
Disallow /*view%3Dprint
Disallow /*page%3Dall
Disallow /*feed.php?
Allow /phpbb/viewtopic.php/*
Disallow /xtarticle/kross-kantri-strit-road-k-chemu-dusha-lezhit
Disallow /xtarticle/0-Aktualnyi-sposob-vybrat-velosiped-novichku
Disallow /xtarticle/0-Kak-legko-i-prosto-soderzhat-transmissiyu-v-poryadke
Disallow /xtarticle/0-Firmennyi-uluchshaizing-dlya-starogo-RS-Monarch
Disallow /xtarticle/0-Kak-uberech-velosiped-ot-krazhi-Sovety
Disallow /xtarticle/0-Chto-delat-esli-ukrali-velosiped

yahoo

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap http://xt.ht/phpbb/sitemap.php

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.