The importer lib/jekyll-import/importers/wordpress.rb does not recognize [code language="ps"] as special and therefore inserts html control codes likes <p> or <br /> into the source code. Also characters like & get converted into &
A better handling would be to either output it with {% highlight PowerShell %} or at least into a <pre> instead.