Accelerating objects are changing their velocity - either the magnitude or the direction of the velocity. Acceleration is the rate at which they change their velocity. Acceleration is a vector quantity; that is, it has a direction associated with it. The direction of the acceleration depends upon which direction the object is moving and whether it is speeding up or slowing down.
