universe-club.jp
robots.txt

Robots Exclusion Standard data for universe-club.jp

Resource Scan

Scan Details

Site Domain universe-club.jp
Base Domain universe-club.jp
Scan Status Ok
Last Scan2024-09-29T16:45:49+00:00
Next Scan 2024-10-29T16:45:49+00:00

Last Scan

Scanned2024-09-29T16:45:49+00:00
URL https://universe-club.jp/robots.txt
Domain IPs 13.35.18.118, 13.35.18.22, 13.35.18.38, 13.35.18.96
Response IP 13.35.18.38
Found Yes
Hash b1971ddbe2d992ab9df5c73b59b75318b8f64a7dbad325d8c952d4be02f7d313
SimHash 680648266053

Groups

*

Rule Path
Disallow /wp/wp-admin/css/
Disallow /wp/wp-admin/images/
Disallow /wp/wp-admin/includes/
Disallow /wp/wp-admin/js/
Disallow /wp/wp-admin/maint/
Disallow /wp/wp-admin/network/
Disallow /wp/wp-admin/user/
Disallow /wp/wp-includes/
Disallow /contact/qn/
Disallow /contact/qn/women/
Disallow /help/categories/interview
Disallow /help/tags/annual-income
Disallow /help/tags/offer-count
Disallow /help/categories/ad
Disallow /help/tags/scout
Disallow /help/categories/join
Disallow /help/tags/trouble
Disallow /help/categories/restaurant
Disallow /help/categories/other-m
Disallow /help/tags/Unsubscribe

Other Records

Field Value
sitemap https://universe-club.jp/sitemap.xml
sitemap https://universe-club.jp/sitemap.xml.gz
sitemap https://universe-club.jp/feed
sitemap https://universe-club.jp/column/sitemap.xml
sitemap https://universe-club.jp/column/sitemap.xml.gz
sitemap https://universe-club.jp/column/feed
sitemap https://universe-club.jp/female/sitemap.xml
sitemap https://universe-club.jp/female/sitemap.xml.gz
sitemap https://universe-club.jp/female/feed
sitemap https://universe-club.jp/help/feed

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
  • Disallow: /
  • User-agent: Googlebot-Image
  • Disallow: /