crewing.top
robots.txt

Robots Exclusion Standard data for crewing.top

Resource Scan

Scan Details

Site Domain crewing.top
Base Domain crewing.top
Scan Status Ok
Last Scan2026-01-25T04:51:38+00:00
Next Scan 2026-02-01T04:51:38+00:00

Last Scan

Scanned2026-01-25T04:51:38+00:00
URL https://crewing.top/robots.txt
Domain IPs 185.91.75.3
Response IP 185.91.75.3
Found Yes
Hash 415df0a11a182a7fb3eec7e63ac8b9b95ce0e1a7b3cafb3f77a01b85531d08f4
SimHash 475deae0ad0f

Groups

*

Rule Path
Disallow /admin.php
Disallow /config
Disallow /header
Disallow /footer
Disallow /pntables
Disallow /referer
Disallow /includes
Disallow /modules/NS-
Disallow /pnadodb
Disallow /cgi-bin
Disallow /DB_phpBB2-login
Disallow /DB_phpBB2-posting
Disallow /DB_phpBB2-profile
Disallow /DB_phpBB2-privmsg-mode-post
Disallow /DB_phpBB2-search
Disallow /DB_phpBB2-viewforum-mark
Disallow /DB_phpBB2-index-mark
Disallow /DB_phpBB2-memberlist
Disallow /DB_phpBB2-viewtopic-p-
Disallow /index.php?module=dsEnterprises&catid=-
Disallow /Downloads-index-req-getit
Disallow /Downloads-index-req-NewDownloadsDate-selectdate
Disallow /PrintArticle
Disallow /print.php
Disallow /SendArticle
Disallow /Recommend_Us
Disallow /modules.php?op=modload&name=Recommend_Us&file=index&req=FriendSend
Disallow /module-Vacancy-tellafriend
Disallow /index.php?module=Vacancy&func=tellafriend
Disallow /module-Vacancy-display-printer
Disallow /index.php?module=Vacancy&func=display&printer
Disallow /module-Vacancy-searchresults
Disallow /Objava-recommend_ad
Disallow /Objava-print
Disallow /Objava-askq
Disallow /Objava-list
Disallow /modules.php?op=modload&name=Objava&file=recommend_ad
Disallow /modules.php?op=modload&name=Objava&file=detail
Disallow /Sections-index-req-printpage
Disallow /modules.php?op=modload&name=Sections&file=index&req=printpage
Disallow /modules.php?op=modload&name=Messages
Disallow /modules.php?op=modload&name=News
Disallow /Messages
Disallow /UserInfo
Disallow /index.php?module=dsProduction
Disallow /rssrus2.php
Disallow /tests

yandex

Rule Path
Disallow

Other Records

Field Value
sitemap https://crewing.top/sm.php

Warnings

  • `host` is not a known field.