We've been coming to Cozumel for about 10 years. We are not divers, just tourists.
We usually don't rent a car, we walk everywhere, sometimes take a cab. We've always stayed West of 30 Ave. As far North as Calle 14, and as far South as Calle 17.
Never had any problems, we have always felt safe.