tc.tabirai.net
robots.txt

Robots Exclusion Standard data for tc.tabirai.net

Resource Scan

Scan Details

Site Domain tc.tabirai.net
Base Domain tabirai.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-27T19:21:38+00:00
Next Scan 2026-03-27T19:21:38+00:00

Last Successful Scan

Scanned2025-08-06T17:38:16+00:00
URL https://tc.tabirai.net/robots.txt
Domain IPs 3.171.198.28, 3.171.198.29, 3.171.198.43, 3.171.198.90
Response IP 3.171.198.29
Found Yes
Hash b2ca808cad9c3c030bbcb0d26478516a9974c2c36e48753fcf24eba29999b347
SimHash c85d50d3f8d0

Groups

sogou web spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

buck

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap http://tc.tabirai.net/sitemap.xml
sitemap http://tc.tabirai.net/sightseeing/sitemap.xml
sitemap http://tc.tabirai.net/car/sitemap_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_chugoku_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_faq_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_hokkaido_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_hokuriku_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_kansai_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_kanto_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_koshinetsu_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_kyushu_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_okinawa_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_shikoku_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_tohoku_tc.xml
sitemap http://tc.tabirai.net/car/sitemap_tokai_tc.xml