Charlton fans fear the worst