Yes, this would pretty much be a nightmare. I can imagine it would be bearable on flights that take less than two hours, but anything more than that and I think it would start to be a problem.
My main concern, also, is emergency exits. Or even regular old exits to use the bathroom. How does one get in and out of these aisles?