Dear Chen,
The LiFi component in OptiSystem is designed for ON-OFF key modulation. you could setup the LiFi Channel characteristic parameter to BER in the component properties popup window. That field is a scroll-down field with three options. Then, you could setup the SNR range from Simulation tab.
Regards,
Ahmad