ieshil.com
robots.txt

Robots Exclusion Standard data for ieshil.com

Resource Scan

Scan Details

Site Domain ieshil.com
Base Domain ieshil.com
Scan Status Ok
Last Scan2024-10-05T13:04:40+00:00
Next Scan 2024-10-12T13:04:40+00:00

Last Scan

Scanned2024-10-05T13:04:40+00:00
URL https://ieshil.com/robots.txt
Redirect http://www.ieshil.com/robots.txt
Redirect Domain www.ieshil.com
Redirect Base ieshil.com
Domain IPs 13.225.4.62, 13.225.4.71, 13.225.4.86, 13.225.4.90
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 7762b8c74bccb0c89df7d62f5d355201a2c3ad43f741d3ca6a7cb26802109691
SimHash 220d84c3df25

Groups

*

Rule Path
Disallow /members/
Disallow /mypage/
Disallow /report/
Disallow /history/
Disallow /search?*
Allow /search?$
Disallow /ai_adviser/lp/s002/
Disallow /ai_adviser/lp/s003/
Disallow /buildings/*/rooms/*
Allow /buildings/*/sale_rooms/$
Disallow /buildings/*/sale_rooms/*
Disallow /adviser_satei_reservations/*
Disallow /investment_purchase/inquiries/

Other Records

Field Value
crawl-delay 1

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /members/
Disallow /mypage/
Disallow /report/
Disallow /search?*
Allow /search?$
Disallow /ai_adviser/lp/s002/
Disallow /ai_adviser/lp/s003/

Other Records

Field Value
crawl-delay 120

msnbot

Rule Path
Disallow /members/
Disallow /mypage/
Disallow /report/
Disallow /search?*
Allow /search?$
Disallow /ai_adviser/lp/s002/
Disallow /ai_adviser/lp/s003/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.ieshil.com/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file