Hundreds of people attended a neo-Nazi rally near the Norfolk border that was not opposed by police in the belief it was a charity event.