I've borrowed many books from our goldfield regions library and as we have seven in the region, they send them to our Heathcote library where I can pick them up there. I have borrowed heaps of Aussie gem books. One in particular I can't recall the name LOL, but it's not just gem books to search gem stones in. Look at books on geology. That's a good start too.
The book I borrowed ended up having gem stone fossicking areas that included my town of Heathcote in Victoria and just down the road where we live at Ladys Pass is a well known area for them in dry creek beds and Toolleen also.
Eldorado, which is near Beechworth in Victoria, is another place, so is Anakie and steiglitz area, between Geelong and Bacchus Marsh in Victoria.
Hope that helps. If you are also a FB member of my group Bendigo and District Gold Prospecting club and Ballarat Gold Seekers, I highly recommend you join these groups and the Dubbo camping prospecting and gem stone group, as members can point you in the right direction.
Hope that helps
Cheers
GarrettGirl