<p>Is it possible to cache database connections when using PHP like you would in a J2EE container?  If so, how?</p>

You cannot instantiate connection pools manually.
But you can use the "built in" connection pooling with the
mysql_pconnect
function.