globimmo.net
robots.txt

Robots Exclusion Standard data for globimmo.net

Resource Scan

Scan Details

Site Domain globimmo.net
Base Domain globimmo.net
Scan Status Ok
Last Scan2024-11-16T22:49:04+00:00
Next Scan 2024-11-23T22:49:04+00:00

Last Scan

Scanned2024-11-16T22:49:04+00:00
URL https://globimmo.net/robots.txt
Redirect https://www.globimmo.net/robots.txt
Redirect Domain www.globimmo.net
Redirect Base globimmo.net
Domain IPs 92.240.236.44
Redirect IPs 92.240.236.44
Response IP 92.240.236.44
Found Yes
Hash 67fc6cfaf99d0f6d5d4b461c51e6ae5706f069e47fb06561b7cec4d9b13237e3
SimHash 731d5198ee5a

Groups

*

Rule Path
Disallow /*/currency/
Disallow /*/units/
Disallow /*/*/cl/
Disallow /*/*/cm/
Disallow /*/*/*/cl/
Disallow /*/*/*/cm/
Disallow /*/bitcoin/edit/
Disallow /*/bitcoin/suggest/
Disallow /*/bitcoin/suggestion-action/
Disallow /*/bitcoin/review-action/
Disallow /*/bitcoin/review-downvote
Disallow /*/bitcoin/review-upvote
Disallow /*/bitcoin/suggestion-downvote
Disallow /*/bitcoin/suggestion-upvote
Disallow /*/bitcoin/review-upvote
Disallow /*/bitcoin/similar/
Disallow /*/detail/review-action/
Disallow /*/unactive/
Disallow /*/list/users/
Disallow /*/map/
Disallow /*/*/map
Disallow /*/add-favourite
Disallow /*/add-hide
Disallow /*/owner-edit
Disallow /*/location/stats/
Disallow /*/window_size
Disallow /*/*/*/window_size
Disallow /*/ads-log
Disallow /*/location/autocomplete/agencyweb
Disallow /*/location/links
Disallow /*/search/similar
Disallow /*/weather
Disallow /*/ablog
Disallow /*/glbmwle
Disallow /*/glbmwlef
Disallow /*/ac-webadmin/
Disallow /*/webadmin/

rainbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

amazonbot

Rule Path
Disallow /image/

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

grapeshotcrawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

oai-searchbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.globimmo.net/sitemap/updatedSearches/updatedSearches.xml
sitemap https://www.globimmo.net/sitemap/searches/searches.xml
sitemap https://www.globimmo.net/sitemap/cities/cities.xml
sitemap https://www.globimmo.net/sitemap/agencies/agencies.xml: