You can certainly write plenty of simple-to-intermediate Elm code without much knowledge of JavaScript. When you get to some advanced things, knowledge of JavaScript will become rather helpful.
That being said, you will have to learn the basics of HTML though, because the View code in Elm has a one-to-one mapping to HTML.
For example, an HTML name input:
<div class="name-input-wrapper">
<label for="name-input">Enter Your Name</label>
<input id="name-input">
</div>
The same name input, in Elm:
div [ class "name-input-wrapper" ]
[ label [ for "name-input" ] [ text "Enter Your Name" ]
, input [ id "name-input" ] []
]