This paper describes behavior conventions that are stable long run outcomes of reinforcement behavior rules in two-person repeated games. Each player plays the repeated game with a fixed but endogenous aspiration, a payoff level that is considered “satisfactory.” Choice probabilities are modified by experience: satisfactory payoff experiences positively reinforce probability weights on chosen actions, while unsatisfactory experiences cause other actions to be tried. Our equilibrium notion requires consistency, equality of aspiration levels with long run average payoffs, and stability, robustness of outcomes with respect to random perturbations of each player’s state. Our main result identifies the set of equilibrium pure strategy conventions: this comprises all efficient, strongly individually rational outcomes, and protected Nash equilibria. Extensions to mixed strategy conventions, and applications to games of coordination, cooperation and oligopoly are discussed.