A hotel which failed to raise the alarm when a Perth family became lost at sea has been hit with penalties following a WorkSafe investigation.