99.co
robots.txt

Robots Exclusion Standard data for 99.co

Resource Scan

Scan Details

Site Domain 99.co
Base Domain 99.co
Scan Status Ok
Last Scan2024-04-28T14:57:08+00:00
Next Scan 2024-05-05T14:57:08+00:00

Last Scan

Scanned2024-04-28T14:57:08+00:00
URL https://99.co/robots.txt
Redirect https://www.99.co/robots.txt
Redirect Domain www.99.co
Redirect Base 99.co
Domain IPs 172.66.40.144, 172.66.43.112, 2606:4700:3108::ac42:2890, 2606:4700:3108::ac42:2b70
Redirect IPs 172.66.40.144, 172.66.43.112, 2606:4700:3108::ac42:2890, 2606:4700:3108::ac42:2b70
Response IP 172.66.40.144
Found Yes
Hash dc8d4632524e6e9370a689df7c440ba2c0fd807d8d0f4da80e1e0e446e8b38a7
SimHash 485dc91ee669

Groups

trovitbot

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /api
Disallow /cdn-cgi/
Disallow /id/account/
Disallow /id/ajax/
Disallow /id/ajax2/
Disallow /id/cart/
Disallow /id/assets/
Disallow /id/images/
Disallow /id/komunitas/ajax/
Disallow /id/ad/
Disallow /id/administration/
Disallow /id/api/
Disallow /id/logout
Disallow /id/signup
Disallow /id/ezy/
Disallow /id/tracker.gif
Disallow /id/guide/analytics
Disallow /id/property/report-ad
Disallow /id/komunitas/forums/create-topic
Disallow /id/property/quick-nav-load
Disallow /id/search/histogram
Disallow /id/p/
Disallow /id/*/pdf
Disallow /id/*/ajax-social-share
Disallow /id/*?pageSize=
Disallow /id/*?listingType
Disallow /id/*/ajax-favorite-button
Disallow /id/*/ajax-text-placeholder
Disallow /id/property/ajax-map
Disallow /id/property/ajax-similar-property-list
Disallow /id/property/insert-visited-property
Disallow /id/property/send-multiple-enquiry-history
Disallow /id/*?tipe_properti=
Disallow /id/*?urut=*
Disallow /id/properti/*/print.pdf
Disallow /id/property/ajax-nearby-agents
Disallow /id/cari/
Disallow /id/amp/
Disallow /singapore/rent/mrt-stations
Disallow /singapore/sale/mrt-stations
Disallow /singapore/s/rent/mrt-stations
Disallow /singapore/s/sale/mrt-stations
Disallow /singapore/rent/schools
Disallow /singapore/sale/schools
Disallow /singapore/s/rent/schools
Disallow /singapore/s/sale/schools
Disallow /singapore/rent/travel-time
Disallow /singapore/sale/travel-time
Disallow /singapore/s/rent/travel-time
Disallow /singapore/s/sale/travel-time
Disallow /singapore/new-launches/marina-one-residence
Disallow /singapore/s/

Other Records

Field Value
sitemap https://www.99.co/singapore/sitemap.xml
sitemap https://www.99.co/id/sitemap-v1/sitemap.xml