Log In Sign Up

webm2.dk
robots.txt

Robots Exclusion Standard data for webm2.dk

Resource Scan

Scan Details

Site Domain webm2.dk
Base Domain webm2.dk
Scan Status Ok
Last Scan2025-08-22T21:51:20+00:00
Next Scan 2025-09-21T21:51:20+00:00

Last Scan

Scanned2025-08-22T21:51:20+00:00
URL https://webm2.dk/robots.txt
Domain IPs 2a02:4780:16:bb97:7bf3:3fdf:d6f6:163d, 2a02:4780:39:de8e:cad3:6b3e:69d3:86d3, 84.32.84.202, 84.32.84.230
Response IP 77.37.48.49
Found Yes
Hash 10d2ab9b8d8e0067748d6e0fcbedd389ba9089b7f37aeacd3166b7a813acaaf9
SimHash 789665826191

Groups

baiduspider

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

bingbot

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

googlebot

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

ia_archiver

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

msnbot

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

naverbot

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

seznambot

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

slurp

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

teoma

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

yandex

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/

yeti

Rule Path
Disallow /ajax/
Disallow /admin/
Disallow /search/
Back to top

Comments

  • Note: Crawling WEBm2 is prohibited unless you have express written permission.
Back to top