Some early systems had no sound hardware at all. But they had a data cassette I/O port that could be abused to output sound.
The first Cassette Port Sound video game was released on March 1981.
Top Books and Tab Books published most of these games.