Log In Sign Up

wsjprofessional.com
robots.txt

Robots Exclusion Standard data for wsjprofessional.com

Resource Scan

Scan Details

Site Domain wsjprofessional.com
Base Domain wsjprofessional.com
Scan Status Ok
Last Scan2024-09-01T09:12:58+00:00
Next Scan 2024-10-01T09:12:58+00:00

Last Scan

Scanned2024-09-01T09:12:58+00:00
URL https://www.wsjprofessional.com/robots.txt
Domain IPs 13.227.254.15, 13.227.254.48, 13.227.254.68, 13.227.254.70
Response IP 13.227.254.48
Found Yes
Hash dec8b295d1536c5a3fcee737d1fd1698f5614f8780f6a4ee7b46aca3a9f193f3
SimHash 471d5f858d43

Groups

wget

Rule Path
Disallow /

wget/1.9

Rule Path
Disallow /

wget/1.6

Rule Path
Disallow /

wget/1.5.3

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.wsjprofessional.com/sitemap
Back to top

Comments

  • robots.txt for https://www.wsjprofessional.com
  • : robots.txt,v 1.00 2017/11/28
Back to top