you can always end up blind or with enophtlamos, double vision when you touch orbital structure. However blindness it very rare ....and mostly several hours postop due to some hematome in the orbit, other complications also rare but it may happen.
I had fractured orbital floor and laterall wall and even did not feel it
no problem with eye
but after fracture (especially mild) eventually swelling / hematoma is milder than after surgery
if you would like to feel safe about this, you have to stop thinking about surgery