Update: A Wimmera Health Care Group spokesman said the The Department of Health and Human Services will conduct contract tracing with the affected individual.
"Close contacts will be identified and monitored carefully to protect the public's health," the spokesman said.
"The best thing people can do is stay at home this Easter."
Earlier: A third case of COVID-19 was recorded in the Horsham Rural City area on Wednesday.
There have been no recorded cases in the Hindmarsh Shire.
In other news:
The latest data from the Department of Health and Human Services showed there are 1212 cases in Victoria, an increase of 21 from Tuesday.
On Tuesday a woman in her eighties passed away in hospital, taking the number of people who have died in Victoria from coronavirus to 12.
The total number of cases includes 635 men and 577 women. Cases range in age from babies to people their early nineties.
There have been 101 confirmed cases of COVID-19 in Victoria that may have been acquired through community transmission. More than 60,000 tests have been conducted to date.
Currently, 45 people have been receiving treatment in hospital - including 12 patients in intensive care - and 736 people have recovered.
Victoria's chief health officer Professor Brett Sutton has urged Victorians to stay vigilant, particularly as we approach the Easter holidays.
"The rules are clear - and they don't change over Easter: if you can stay at home, you must stay at home," he said.
"This is tough for many families, but no Easter holiday is worth a life. Stay at home, protect the health system, and save lives.
"There is no doubt about it - physical distancing will save lives. I urge people not to look for loopholes but to follow the advice and do the right thing."
The Department of Health and Human Services has a hotline for public information on COVID-19, which is 1800 675 398.
Further information is also available at www.dhhs.vic.gov.au/coronavirus.
We have removed our paywall from this story about the coronavirus. This is a rapidly changing situation and we want to make sure our readers are as informed as possible. If you would like to support our journalists you can subscribe for the Wimmera Mail-Times here, for the Stawell Times-News here, and for the Ararat Advertiser here.
Sign up for our newsletter to stay up to date.