Alexander Forba, reportedly from Cameroon, would remain in custody to await his next appearance at the Pretoria Magistrate's Court next month.
Prosecutor Sipho Letsoalo told the court that Forba posed a flight risk and the State would oppose any bid to release him on bail.
He said police had also not verified the address given by Forba.
"The accused becomes a bit more dangerous with the risk of flight. If they provide an address, the police will go there and verify," said Letsoalo.
He said media outlets intending to record the court proceedings should apply to the chief magistrate before the day of the court sitting.
"This is not an ordinary case we are dealing with. This case has public interest that has been demonstrated," said Letsoalo.
Several journalists were camping outside the high security prison, formerly known as C-Max.
Looking submissive, Forba was led into court before midday. He never said a word.
The 32-year-old was arrested last week at a flat he shared with his girlfriend and daughter in Pretoria West.
Forba is accused of using the newborn as a weapon to thump his girlfriend following a fight.
The child was declared dead on arrival at the Kalafong Hospital.