By the end of the sixties he had become frustrated with rock music due to the lack of experimentation. Around this time he was discovering the sound of German bands like Can, Faust, Neu! and Kraftwerk. These bands were creating new sounds, something Miller wanted to hear.
He began listening to punk because of the energy and excitement of the music. He liked the whole do-it-yourself attitude that came with the style of music and later spilled over into the electronic music scene.
Synthesizers were becoming cheaper to buy and new bands were appearing such as Throbbing Gristle and Cabaret Voltaire. This inspired Miller to create his own music. Making some money from film editing and working ridiculous hours he gathered enough money to buy a cheap Korg 700S synthesizer and a four track tape recorder. This led to the creation of The Normal, Silicon Teens and lots of other projects.