One of my favorite spots would be A21 the canoe/kayak launch area. There is plenty of structure and it is all an easy walk to just about anywhere out back. Light gear is all you need and as the water is still warm you might not have to wear waders just yet. Just be careful as you walk out straight there is a deeper spot that might be over your head (don't ask how I know). At dusk or dawn is the sweet time along the banks.
There are tons of fish out there. Just park your car in the A21 lot and it is just a short walk back there on a gravel road.
If you are looking for other ideas there are plenty of piers to fish off of and this time of year there is no charge for them. Seaside Heights has 3 and Seaside Park has many to choose from.