Not sure of the set up if it is a tensioner or alternator adjustment.Check this.If the alternator has a slide bracket then slacken the nut and put leveredge between the alternator and the engine with a bar or something and tighten up the nut again tight.
If it is a tensioner then this has an adjustment on it as well but i am sure it is the alternator