dealmoon.com.au
robots.txt

Robots Exclusion Standard data for dealmoon.com.au

Resource Scan

Scan Details

Site Domain dealmoon.com.au
Base Domain dealmoon.com.au
Scan Status Ok
Last Scan2024-05-17T15:45:23+00:00
Next Scan 2024-05-24T15:45:23+00:00

Last Scan

Scanned2024-05-17T15:45:23+00:00
URL https://dealmoon.com.au/robots.txt
Redirect https://www.dealmoon.com.au/robots.txt
Redirect Domain www.dealmoon.com.au
Redirect Base dealmoon.com.au
Domain IPs 54.153.244.96
Redirect IPs 108.156.133.105, 108.156.133.14, 108.156.133.50, 108.156.133.81
Response IP 108.156.133.14
Found Yes
Hash 9b60f3922f3db7f81438cbab8be856ef296e3f55f68fd7578023aec7c5608ed3
SimHash 01a9a83f0c93

Groups

*

Rule Path
Disallow /cn/top/
Disallow /en/top/
Disallow /top/
Disallow /v2/
Disallow /Log/
Disallow /h5/api/
Disallow /exec/
Disallow /bg/
Disallow /cnen/
Disallow /guide-preview/
Disallow /enen/
Disallow /vitamins/
Disallow /?sort=*
Disallow /?v=list
Disallow /u/valentines-day/
Disallow /Any-Category/
Disallow /*.html%2$
Disallow /top/condom
Disallow /www/
Disallow /mob/
Disallow /*-profile
Disallow /www/home/ajax-load
Disallow /mob/home/ajax-load
Disallow /www/home/in-europe
Disallow /mob/home/in-europe
Disallow /www/comment/list
Disallow /mob/comment/list
Disallow /check-show-ccap
Disallow /www/deal/get-deal-comment-fav-nums
Disallow /www/public/push-settings
Disallow /www/home/bottom-activity
Disallow /search/getRecommendKey
Disallow /product/guess-like
Disallow /post/ajax/likes
Disallow /product/s/
Disallow /product/aggregate/
Disallow /product/tag/
Disallow /product/*brand%3D
Disallow /product/*subject%3D
Disallow /product/*store%3D
Disallow /product/*price%3D
Disallow /product/*sort%3D
Disallow /product/*page%3D
Disallow /product/*deal%3D

Other Records

Field Value
sitemap https://www.dealmoon.com.au/newsitemap/www/sitemap.xml

Comments

  • disable 2019.02.27
  • Disallow: /gift/
  • disallow ajax path
  • sitemap