This seems to be the first Abbott and Costello story in comic books. From SUPER MAGICIAN #8, which was published by Street and Smith in 1942.
Reblogged from http://fourcolorshadows.blogspot.com/
Abbott and Costello were making movies for Universal and during the same period were on the radio with Chase and Sanborn as their sponsors.
Abbott and Costello: