Lexington Market Safe?

I'm driving up to Connecticut from Florida. I have heard that Lexington Market has excellent eats, but also been told that it is in a dodgy area. I will be driving a BMW. Should I this area?