This work presents an interview-based retrospective study conducted with students and teachers with blindness and low vision regarding mathematical diagrams. It aims to understand the experience of students and teachers in learning and creating mathematical diagrams and the need and scope of improvement through technological interventions in the Indian context. We conducted semi-structured interviews with ten students and four teachers with blindness or low vision and analyzed the collected data using thematic analysis. We found that students have little interest in learning and practicing mathematical diagrams on analog tools due to these tools' limited features. In addition, time-consuming mathematical drawings as a part of the academic assessment process and less awareness of their future use contribute to this reduced interest. We believe using a collaborative learning process through digital tools with tactile feedback can facilitate easy and quick understanding with a more competitive and enjoyable environment to learn mathematical diagrams. © 2021 ACM.