A Novel Approach to Visualization of High-Dimensional Data by Pairwise Fusion Matrices Using t-SNE

We applied t-distributed stochastic neighbor embedding ( t-SNE) to visualize Urdu handwritten numerals (or digits). The data set used consists of 28 images ofhandwritten Urdu numerals. The data set was created by inviting authors from diff erent categories ofnative Urdu speakers. One of the challenging and critical issues for the correct visualization of Urdu numerals is shape similarity between some of the digits. This issue was resolved using t-SNE, by exploiting local and global structures of the large data set at different scales. The global structure consists of geometrical features and local structure is the pixel-based information for each class of Urdu digits. We introduce a novel approach that allows the fusion of these two independent spaces using Euclidean pair wise distances in a highly organized and principled way. The fusion matrix embedded with t-SNE helps to locate each data point in a two (or three-) dimensional map in a very different way. Furthermore, our proposed approach focuses on preserving the local structure of the high- dimensional data while mapping to a low-dimensional plane. The novelty of our approach lies in the fact that we embed Euclidean distances in standard t-SNE in order to successfully visualize the high-dimensional data represented in multiple independent observations. The visualizations produced by t-SNE outperformed other classical techniques like principal component analysis (PCA) and auto-encoders (AE) on our handwritten Urdu numeral dataset.