The man appeared at a western Victorian court on Monday where he pleaded guilty to assault and firearm charges.

The court heard the man was a caregiver of three grandchildren.

Police were sent an audio recording of an abuse incident at the man's property on June 8. The audio was recorded by a family member who was also present at the time of the incident.

The audio recording was not heard in court. Police prosecutor Senior Constable Michelle Wentworth told the court what was said in the recording.

In the recording, the man had prepared dinner for the children and became enraged at the speed in which the children were eating.

The man then used "vile" and "degrading language" towards all three children. The man then stuffed a hotdog into the mouth of one of the children, and used his hand to make the child's jaw move up and down. He told the child to "get f***ing eating".

The man also threatened the children, saying "you f***ing spit that out and I'll punch you in the head" and "I'll stomp on your heads you c***s" and "you step out of your room and I'll belt your a**".

Police arrested the man on June 9.

While searching the man's property police found seven firearms and incorrectly stored ammunition. One of the firearms was an unregistered power rifle. Police also located 115 grams of cannabis.

The man was taken to a police station and interviewed. He was remanded into custody to appear at court on July 29.

In an interview with police, the man admitted being the voice in the recording but denied being overly forceful with the children.

He told police he smoked cannabis four times a week for back pains and cultivated the drug himself.

The court heard police had interviewed two of the children. Senior Constable Wentworth said police would have the children's witness statements read out and would play the audio recording in court.

The man's defence lawyer Nick Graham said the man was distressed about the flow-on impacts of his actions.

"My client's future relationship with the children is in doubt and that is a great distress to him," Mr Graham said.

The man was remanded into police custody and the case was adjourned to July 31.

While you're with us, you can now receive updates straight to your inbox twice weekly from the Wimmera Mail-Times. To make sure you're up-to-date with all the news from across the Wimmera, sign up below.