Sure, manmade structures make a significant difference but what about relatively featureless beaches?
Just about every good beachbreak I can think of has a significant dropoff and/or submarine canyon just offshore and that has to play a significant factor. That extra dose of refraction helps a lot, even more so than jetty placement IMO. Look at the difference between say, Pacific Beach and Blacks. They face pretty much the same direction, open to the same swells, hell, PB even has a pier, but laughably different in terms of wave quality. The manmade features do help with channels, though, which is a godsend for beachbreaks.
Agree about the shorter periods. Well, it's not that long periods aren't good, it's just so much water moving that everything just becomes a lot more difficult to deal with, not to mention just getting out in the first place. On the other hand, shorter periods where you can't see over the top of waves to see waves behind them can make things a royal pain in the ass. At least you don't have as much time to bemoan your soon-to-be underwater fate.