"There is very much a respect between all of us," the "As It Was" singer shared of his One Direction bandmates ... "I feel really lucky that we always had each other to be this unit that ...