Hows this, I'd get a houseboat armed with a Greek Fire launcher. While the flames floating on the water hold the zombies back I'll sail away unharmed. And, Greek Fire is easy to make with things that can be found in close proximity to the coast. On that note, several muskets would work wonders as well, so I can make my own ammunition. In addition a large Tesla Coil, or some other directed energy weapon would work wonders, and only require several large batteries or a generator to run. I would fish for food supplies, and desalinate the ocean for water.

Of course, a sword or some other close combat weapon would also help tremendously. I'll likely need to fight my way to the saltpeter and sulfur I need for Gunpowder and Greek Fire.