Can I still apply for finance if I only have a provisional licence?

Yes. However, the lenders are limited so you will be restricted to advance and vehicle type finance only. You may have to provide proof of fully comprehensive car insurance to proceed.