nycre4j.com
robots.txt
Robots Exclusion Standard data for nycre4j.com
Resource Scan
Scan Details
| Site Domain | nycre4j.com |
| Base Domain | nycre4j.com |
| Scan Status | Ok |
| Last Scan | 2024-10-07T05:44:44+00:00 |
| Next Scan | 2024-10-21T05:44:44+00:00 |
Last Scan
| Scanned | 2024-10-07T05:44:44+00:00 |
| URL | https://nycre4j.com/robots.txt |
| Domain IPs | 151.101.1.195, 151.101.65.195 |
| Response IP | 151.101.65.195 |
| Found | Yes |
| Hash | 88febae1835a1a2fa4f01cb6cc01bcd8c4859c81299b3a22cc915acce2bc07ba |
| SimHash | c11c55dacb10 |
Groups
pinterestbot
googlebot-news
baiduimagespider
semrushbot/2
semrushbot*
ia_archiver
archive.org_bot
ia_archiver-web.archive.org
megalodon
baiduspider
baiduspider+
baiduchecker
baidumobaider
baidu*
baidu*
ccbot
scrapy*
adsbot
ahrefsbot
mj12bot
petalbot
yandexbot
yandexwebmaster
imagesiftbot
tineye
tineye-bot
blexbot
ioncrawl
go-http-client/1.1
| Rule | Path |
|---|---|
| Disallow | / |
googlebot-image
| Rule | Path |
|---|---|
| Allow | /favicon.png |
| Allow | /favicon.ico |
| Allow | /favicon* |
| Allow | /apple* |
| Allow | /images/oxford_1800w_op94.png |
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /privacy_policy.html |
| Disallow | /area/area-top/ |
| Disallow | /tags/ |
| Disallow | /categories/ |
| Disallow | /cloud-*/ |
| Disallow | /featured-condo/page/ |
| Allow | /featured-condo/condo29/ |
| Allow | /featured-condo/condo28/ |
| Disallow | /featured-condo/condo* |
| Disallow | /knowledge/page/ |
| Disallow | /knowledge/inside_japanese_investments_in_american_realestate/ |
| Disallow | /knowledge/guarantee_company/ |
| Disallow | /knowledge/nyc_rent_survey_2019.4/ |
| Disallow | /knowledge/investment_property_1/ |
| Disallow | /knowledge/illegal_rental_crackdown/ |
| Disallow | /knowledge/rental_market_1q2022/ |
| Disallow | /knowledge/condo_sales_2021_2q/ |
| Disallow | /knowledge/booming_lic/ |
| Disallow | /solution/qa_fullver/ |
| Disallow | /solution/prerequisites/ |
| Disallow | /service/$ |
| Disallow | /_firebase_auth*/ |
| Disallow | /consulting/sep2019_survey_js2t9x/ |
| Disallow | /pricing/individuals/ |
| Disallow | /library/japanese-early-childhood-edu/ |
| Allow | /library/reviews* |
| Allow | /library/nycschools/ |
| Allow | /library/early-childhood-edu/ |
| Allow | /library/disclosureforms/ |
| Allow | /library/supermarkets/ |
| Disallow | /library/* |
| Disallow | /contactform.html |
| Allow | /rental_listing_top/ |
| Disallow | /rental_listing_* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nycre4j.com/sitemap.xml |
Warnings
- 3 invalid lines.