|
[1]
|
Lecun, Y., Chopra, S., Hadsell, R., Ranzato, M. and Huang, F.J. (2006) A Tutorial on Energy-Based Learning. In: Bakir, G., Hofman, T., Schölkopf, B., Smola, A., Taskar, B., Eds., Predicting Structured Data, The MIT Press. [Google Scholar] [CrossRef]
|
|
[2]
|
Vaswani, A., Shazeer, N., et al. (2017) Attention Is All You Need. https://ui.adsabs.harvard.edu/abs/2017arXiv170603762V>
|
|
[3]
|
LeCun, Y., Bengio, Y. and Hinton, G. (2015) Deep Learning. Nature, 521, 436-444. [Google Scholar] [CrossRef] [PubMed]
|
|
[4]
|
Kitaev, N., Kaiser, Ł. and Levskaya, A. (2020) Reformer: The Efficient Transformer. https://ui.adsabs.harvard.edu/abs/2020arXiv200104451K>
|
|
[5]
|
Zaremba, W., Sutskever, I. and Vinyals, O. (2014) Recurrent Neural Network Regularization. https://ui.adsabs.harvard.edu/abs/2014arXiv1409.2329Z
|
|
[6]
|
Liu, F., Zhang, B., Chen, G., Gong, G., Lu, H. and Li, W. (2021) A Novel Configurable High-Precision and Low-Cost Circuit Design of Sigmoid and Tanh Activation Function. 2021 IEEE International Conference on Integrated Circuits, Technologies and Applications (ICTA), Zhuhai, 24-26 November 2021, 222-223. [Google Scholar] [CrossRef]
|
|
[7]
|
Pogiri, R., Ari, S. and Mahapatra, K.K. (2022) Design and FPGA Implementation of the LUT Based Sigmoid Function for DNN Applications. 2022 IEEE International Symposium on Smart Electronic Systems (iSES), Warangal, 18-22 December 2022, 410-413. [Google Scholar] [CrossRef]
|
|
[8]
|
Moposita, T., Trojman, L., Crupi, F., Lanuzza, M. and Vladimirescu, A. (2022) Voltage-to-Voltage Sigmoid Neuron Activation Function Design for Artificial Neural Networks. 2022 IEEE 13th Latin America Symposium on Circuits and System (LASCAS), Puerto Varas, 1-4 March 2022, 1-4. [Google Scholar] [CrossRef]
|
|
[9]
|
Xing, S. and Wu, C. (2020) Implementation of a Neuron Using Sigmoid Activation Function with CMOS. 2020 IEEE 5th International Conference on Integrated Circuits and Microsystems (ICICM), Nanjing, 23-25 October 2020, 201-204. [Google Scholar] [CrossRef]
|
|
[10]
|
Kagalkar, A. and Raghuram, S. (2020) CORDIC Based Implementation of the Softmax Activation Function. 2020 24th International Symposium on VLSI Design and Test (VDAT), Bhubaneswar, 23-25 July 2020, 1-4. [Google Scholar] [CrossRef]
|
|
[11]
|
Yang, Z., He, J., Yan, Z., Hu, Y., Li, X., Dong, N., et al. (2024) Inverse-Designed Integrated All-Optical Nonlinear Activators for Optical Computing. Optics Express, 32, Article 34001. [Google Scholar] [CrossRef] [PubMed]
|
|
[12]
|
Yan, T., Wu, J., Zhou, T., Xie, H., Xu, F., Fan, J., et al. (2019) Fourier-Space Diffractive Deep Neural Network. Physical Review Letters, 123, Article 023901. [Google Scholar] [CrossRef] [PubMed]
|
|
[13]
|
Zhao, Y., Chen, Z., Ding, Z., Ren, H. and Nelson, J.S. (2002) Real-Time Phase-Resolved Functional Optical Coherence Tomography by Use of Optical Hilbert Transformation. Optics Letters, 27, 98-100. [Google Scholar] [CrossRef] [PubMed]
|
|
[14]
|
Zhao, Z., Wang, Y., Guan, C., Zhang, K., Wu, Q., Li, H., et al. (2022) Deep Learning-Enabled Compact Optical Trigonometric Operator with Metasurface. PhotoniX, 3, Article No. 15. [Google Scholar] [CrossRef]
|
|
[15]
|
You, J., Han, Z., Zhang, N., Zhang, Q., Zhang, Y., Liu, Y., et al. (2024) All-Optic Logical Operations Based on the Visible-Near Infrared Bipolar Optical Response. Advanced Science, 11, Article 2404336. [Google Scholar] [CrossRef] [PubMed]
|
|
[16]
|
Lin, X., Rivenson, Y., Yardimci, N.T., Veli, M., Luo, Y., Jarrahi, M., et al. (2018) All-Optical Machine Learning Using Diffractive Deep Neural Networks. Science, 361, 1004-1008. [Google Scholar] [CrossRef] [PubMed]
|
|
[17]
|
Wang, T., Sohoni, M.M., Wright, L.G., Stein, M.M., Ma, S., Onodera, T., et al. (2023) Image Sensing with Multilayer Nonlinear Optical Neural Networks. Nature Photonics, 17, 408-415. [Google Scholar] [CrossRef]
|
|
[18]
|
Li, Y., Li, J. and Ozcan, A. (2024) Nonlinear Encoding in Diffractive Information Processing Using Linear Optical Materials. Light: Science & Applications, 13, Article No. 173. [Google Scholar] [CrossRef] [PubMed]
|
|
[19]
|
Dou, H., Deng, Y., Yan, T., Wu, H., Lin, X. and Dai, Q. (2020) Residual D2NN: Training Diffractive Deep Neural Networks via Learnable Light Shortcuts. Optics Letters, 45, 2688-2691. [Google Scholar] [CrossRef] [PubMed]
|
|
[20]
|
Li, J., Gan, T., Bai, B., Luo, Y., Jarrahi, M. and Ozcan, A. (2023) Massively Parallel Universal Linear Transformations Using a Wavelength-Multiplexed Diffractive Optical Network. Advanced Photonics, 5, Article 016003. [Google Scholar] [CrossRef]
|
|
[21]
|
Zhou, T., Lin, X., Wu, J., Chen, Y., Xie, H., Li, Y., et al. (2021) Large-Scale Neuromorphic Optoelectronic Computing with a Reconfigurable Diffractive Processing Unit. Nature Photonics, 15, 367-373. [Google Scholar] [CrossRef]
|
|
[22]
|
Matsushima, K. and Shimobaba, T. (2009) Band-Limited Angular Spectrum Method for Numerical Simulation of Free-Space Propagation in Far and Near Fields. Optics Express, 17, 19662-19673.
|