Hello tayyab
Since EVM is generaly a deviation of point at receiver side from ideal one,you can analyze it by incresing power.i am not able to open your file,but reccomend you firt try to simulate the system without fiber of 5 km,see the evm directly at receiver side.if you get good evm then try the transmission by boosting the signsl using edfa .i think this will help ypu.