Thank you guys for the quick response. This forum is awesome.
Increasing number of transparent bounces fixed it.
@SterlingRoth What do you mean by “real glass”. Is there anyway to reduce noise? Some way to fake glass?
Will using just Principled BSDF be better choice?