I fly small aircraft and dive also. I would fly to your destination, do your dives and stay for 12 hours minimum. There are many people who dive then travel up mountains 1,000 + feet and are fine. There are also people who get bent following the tables very conservatively. I personally wouldn’t risk testing MY body as pilot in command after diving. I hardly fly and dive anyway because the weight of the gear is too great for a Cessna Skyhawk or similar aircraft. Keep in mind if anything happens you’ll most likely lose your medical at the least or pass out and crash at the worst.