Depends on what you are connecting to on each side of the converter and what you want to put through it (what type of audio content) and the resulting experience you want to get. In other words, ...
Keeping your electronics clean is generally important for keeping them functional, but should you clean your TV's HDMI ports?