Possibly a daft question, you did clean the commutator on the motor when you changed the brushes I presume.
One other possibility, what is the power supply? have you checked it with another motor? A dying battery or a transformer supply with part of the rectifier going could do what you describe.
Chas