Richloom Weaving plans to permanently close its High Point plant on Elm Street by April 4, according to a WARN notice filed with the state Department of Commerce.