globinmo.net
robots.txt

Robots Exclusion Standard data for globinmo.net

Resource Scan

Scan Details

Site Domain globinmo.net
Base Domain globinmo.net
Scan Status Ok
Last Scan2024-10-05T15:33:28+00:00
Next Scan 2024-10-12T15:33:28+00:00

Last Scan

Scanned2024-10-05T15:33:28+00:00
URL http://globinmo.net/robots.txt
Redirect https://www.globimmo.net/robots.txt
Redirect Domain www.globimmo.net
Redirect Base globimmo.net
Domain IPs 92.240.236.44
Redirect IPs 92.240.236.44
Response IP 92.240.236.44
Found Yes
Hash 8ee0f36ab2012cfe5d717ee1ed0fa6528ca6ed398c8575d7b28485d1f79d6355
SimHash 771dd598eeda

Groups

*

Rule Path
Disallow /*/currency/
Disallow /*/units/
Disallow /*/*/cl/
Disallow /*/*/cm/
Disallow /*/*/*/cl/
Disallow /*/*/*/cm/
Disallow /*/bitcoin/edit/
Disallow /*/bitcoin/suggest/
Disallow /*/bitcoin/suggestion-action/
Disallow /*/bitcoin/review-action/
Disallow /*/bitcoin/review-downvote
Disallow /*/bitcoin/review-upvote
Disallow /*/bitcoin/suggestion-downvote
Disallow /*/bitcoin/suggestion-upvote
Disallow /*/bitcoin/review-upvote
Disallow /*/bitcoin/similar/
Disallow /*/detail/review-action/
Disallow /*/unactive/
Disallow /*/list/users/
Disallow /*/map/
Disallow /*/*/map
Disallow /*/add-favourite
Disallow /*/add-hide
Disallow /*/owner-edit
Disallow /*/location/stats/
Disallow /*/window_size
Disallow /*/*/*/window_size
Disallow /*/ads-log
Disallow /*/location/autocomplete/agencyweb
Disallow /*/location/links
Disallow /*/search/similar
Disallow /*/weather
Disallow /*/ablog
Disallow /*/glbmwle
Disallow /*/glbmwlef
Disallow /*/ac-webadmin/
Disallow /*/webadmin/

rainbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

grapeshotcrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.globimmo.net/sitemap/updatedSearches/updatedSearches.xml
sitemap https://www.globimmo.net/sitemap/searches/searches.xml
sitemap https://www.globimmo.net/sitemap/cities/cities.xml
sitemap https://www.globimmo.net/sitemap/agencies/agencies.xml: