The City of Essex has begun work on a $2.7 million water system improvement project.