Hi Chee,
I have gone through your design “Coherent-Detection-Optical-OFDM-System-TRIAL2.osd”. Please do not use OFDM modulator and demodulator block from optisystem 12. Instead download 13 and trying using them. Besides the attenuation which you have chosen for FSO is very low. (Typicall its 25dB/Km).