Sounds pretty successful, actually - and bravo to you for starting out on permit. I'm sure more than a few of us have had permit days where we barely get a shot at all, much less an eat.
I've been focused on flats fishing for the past couple of years, and I've found the education to be painfully slow, but steadily progressing. The first couple times out I couldn't even see fish until they were under my rod tip (and even then...). Then I could see them, but invariably freak out and blow the shot. Then I could calm myself to make the shot, but invariably muff the set. After a couple years, I can now sometimes pull it all together and land a fish. Sometimes.
(I should note that my first time ever flats fishing I got a Grand Slam, which greatly annoyed the people in the lodge and gave me outsize confidence in my angling abilities, confidence that was quickly corrected the next day when I got skunked.)