monster.com.vn
robots.txt

Robots Exclusion Standard data for monster.com.vn

Resource Scan

Scan Details

Site Domain monster.com.vn
Base Domain monster.com.vn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-27T13:40:35+00:00
Next Scan 2024-10-25T13:40:35+00:00

Last Successful Scan

Scanned2023-10-02T11:49:06+00:00
URL https://monster.com.vn/robots.txt
Redirect https://www.monster.com.vn/robots.txt
Redirect Domain www.monster.com.vn
Redirect Base monster.com.vn
Domain IPs 20.198.89.77
Redirect IPs 2600:1413:b000:6::17d5:2bcf, 2600:1413:b000:6::17d5:2bd0, 96.17.96.15, 96.17.96.22
Response IP 23.35.148.153
Found Yes
Hash 48239a319bb7df71da74887e17eca2ddcd4d4e5d960b96ac9dfb466ce2e69ffb
SimHash ec034f935a95

Groups

*

Rule Path
Disallow /seeker/dashboard
Disallow /seeker/profile
Disallow /pwa/
Disallow /trex/*/
Disallow */middleware/publish/events
Disallow /mthinking/
Disallow *track_aor.html
Disallow /penguin/api/public/events/new/v2/publish
Disallow *?*
Disallow /middleware/

googlebot-image

Product Comment
googlebot-image Googlebot
Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

yahooseekerm1a1-r2d2

Rule Path
Disallow

msnbot_mobile

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.monster.com.vn/xmlsitemap/sitemap-index.xml
sitemap https://www.monster.com.vn/xmlsitemap/todays-jobs-sitemap.xml