It certainly sounds like a grounding issue

Another common cause of similar noise is wiring the output jack the wrong way around...