Just untar will_paginate-<version>.tgz in 

<your app path>/plugins

For usage, see will_paginate-Rails-README