Does the closing balance per bank equal the closing balance on my bank statement?

It should; however, it depends on whether you have been updating the opening balance on each bank statement correctly. The Closing balance per bank calculates the total of all transactions posted to the bank account in question. The closing balance on a bank statement is entered by the users and has no impact on the bank rec summary.