Dr. Wu-Jun LI’s excellent Lit review and practicalities supporting their own papers. Kevin Zakka’s kNN classification using Neighbourhood Components Analysis is an illustrated guide to a type of dimensionality reduction I had not heard of before that looks handy for nearest-neighbour search, which I suppose is the entry-level use here. (Dwibedi et al. 2019)
Learnable hashes for similarity search
Learnable indexes for arbitrary search
Hip for a while there. Learned bloom filters etc can outperform hand-designed ones is the tl;dr. (Beutel et al. 2017; Kraska et al. 2017)
See also Mitzenmacher’s clarifications on false positive rate in such filters.
Token embedding indices
LLM style. See transformers for now.
References
Beutel, Alex, Tim Kraska, H. Chi, Jeffrey Dean, and Neoklis Polyzotis. 2017. “A Machine Learning Approach to Databases Indexes.” In Advances In Neural Information Processing Systems.
Cao, Zhangjie, Mingsheng Long, Jianmin Wang, and Philip S. Yu. 2017. “HashNet: Deep Learning to Hash by Continuation.” arXiv:1702.00758 [Cs], February.
Chiu, Chih-Yi, Amorntip Prayoonwong, and Yin-Chih Liao. 2020. “Learning to Index for Nearest Neighbor Search.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (8): 1942–56.
Dwibedi, Debidatta, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet, and Andrew Zisserman. 2019. “Temporal Cycle-Consistency Learning,” April.
Gordo, Albert, Jon Almazan, Jerome Revaud, and Diane Larlus. 2016. “End-to-End Learning of Deep Visual Representations for Image Retrieval.” arXiv:1610.07940 [Cs], October.
Graves, Alex, Greg Wayne, Malcolm Reynolds, Tim Harley, Ivo Danihelka, Agnieszka Grabska-Barwińska, Sergio Gómez Colmenarejo, et al. 2016. “Hybrid Computing Using a Neural Network with Dynamic External Memory.” Nature advance online publication (October).
Kraska, Tim, Alex Beutel, Ed H. Chi, Jeffrey Dean, and Neoklis Polyzotis. 2017. “The Case for Learned Index Structures.” arXiv:1712.01208 [Cs], December.
Lai, Hanjiang, Yan Pan, Ye Liu, and Shuicheng Yan. 2015. “Simultaneous Feature Learning and Hash Coding with Deep Neural Networks.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3270–78.
Li, Wu-Jun, Sheng Wang, and Wang-Cheng Kang. 2015. “Feature Learning Based Deep Supervised Hashing with Pairwise Labels.” arXiv Preprint arXiv:1511.03855.
Lin, Kevin, Huei-Fang Yang, Jen-Hao Hsiao, and Chu-Song Chen. 2015. “Deep Learning of Binary Hash Codes for Fast Image Retrieval.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 27–35.
Liong, Erin, Jiwen Lu, Gang Wang, Pierre Moulin, and Jie Zhou. 2015. “Deep Hashing for Compact Binary Codes Learning.” In 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2475–83.
Mitra, Bhaskar, and Nick Craswell. 2017. “Neural Models for Information Retrieval.” arXiv:1705.01509 [Cs], May.
Nagathan, Arvind, Jitendranath Mungara, and Manimozhi. 2014. “Content-Based Image Retrieval System Using Feed-Forward Backpropagation Neural Network.” International Journal of Computer Science and Network Security (IJCSNS) 14 (6): 70.
Schüle, Maximilian, Frédéric Simonis, Thomas Heyenbrock, Alfons Kemper, Stephan Günnemann, and Thomas Neumann. 2019. “In-Database Machine Learning: Gradient Descent andTensor Algebra for Main Memory Database Systems.”
Wang, J., T. Zhang, j song, N. Sebe, and H. T. Shen. 2018. “A Survey on Learning to Hash.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 769–90.
Xia, Rongkai, Yan Pan, Hanjiang Lai, Cong Liu, and Shuicheng Yan. 2014. “Supervised Hashing for Image Retrieval via Image Representation Learning.” In AAAI, 1:2156–62.
Xu, Jiaming, Peng Wang, Guanhua Tian, Bo Xu, Jun Zhao, Fangyuan Wang, and Hongwei Hao. 2015. “Convolutional Neural Networks for Text Hashing.” In IJCAI, 1369–75.
Yang, H. F., K. Lin, and C. S. Chen. 2018. “Supervised Learning of Semantics-Preserving Hash via Deep Convolutional Neural Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (2): 437–51.
Zhang, Ruimao, Liang Lin, Rui Zhang, Wangmeng Zuo, and Lei Zhang. 2015. “Bit-Scalable Deep Hashing with Regularized Similarity Learning for Image Retrieval and Person Re-Identification.” IEEE Transactions on Image Processing 24 (12): 4766–79.
Zoran, Daniel, Balaji Lakshminarayanan, and Charles Blundell. 2017. “Learning Deep Nearest Neighbor Representations Using Differentiable Boundary Trees.” arXiv:1702.08833 [Cs], February.
No comments yet. Why not leave one?