You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Working on applied machine learning for home robotics, building perception and learning-based components for autonomous systems.
174
+
Built an end-to-end pipeline for training and deploying segmentation and detection models for indoor navigation, packaging deployment deliverables for the DAM team. Migrated a complex perception system to the Qualcomm DragonWing QCS6490P chipset and NVIDIA IoT kits, improving edge inference speed by ~30% in barebones Linux environments using GStreamer. Also designed and deployed a custom 6DOF pose estimation proof-of-concept pipeline to ensure reliable target locking and rebasing during the hardware migration.
Developed gaze estimation models using Computer Vision and Deep Learning for Affective Computing in education. Analyzed correlations between gaze patterns and student engagement to establish quantitative measures of attention.
193
+
Developed and benchmarked a Vision Transformer (ViViT) for classroom activity recognition on a 927-clip EduNet subset, achieving 88% test accuracy by fine-tuning a Kinetics-400 pre-trained model with a 224x224 video preprocessing pipeline. Validated generalizability on an independent 100-video dataset (72% accuracy) and generated gradient-based saliency maps to confirm focus on key regions (e.g. raised hand, board writing). Analyzed gaze and activity patterns to derive quantitative student engagement measures.
Optimized a SAM-based image segmentation GUI, enabling efficient AI-assisted annotation, and developed an automated mechanism to aggregate segmented regions into sub-scenes, enhancing the semantic understanding of complex images.
213
+
Implemented and optimized a PyQt5-based GUI integrating SAM for image segmentation, enabling efficient AI-assisted annotation. Developed and automated a mechanism to aggregate individually segmented regions into larger sub-scenes using advanced image processing techniques, advancing the semantic understanding of complex images and reducing manual effort.
Worked under under the supervision of <ahref="https://www.ceeri.res.in/profiles/dhiraj-sangwan/" target="_blank">Dr Dhiraj Sangwan</a> on developing a comprehensive image restoration pipeline, enhancing my skills in Computer Vision and Deep Learning, covering Image Segmentation, Image Processing, and GANs.
232
+
Worked under the supervision of <ahref="https://www.ceeri.res.in/profiles/dhiraj-sangwan/" target="_blank">Dr. Dhiraj Sangwan</a> on restoring and segmenting deteriorated Rajasthani murals using deep learning models like U-Net++, DeepLabV3+, PSPNet, and FPN. Developed a synthetic damaged-image generation pipeline using GANs (StyleGAN2-ADA) and crafted diverse binary masks to simulate complex real-world mural damage. Implemented a state-of-the-art inpainting pipeline achieving an SSIM score of 0.9812 for reinstating missing sections.
Extension of the <ahref="https://virtualhumans.mpi-inf.mpg.de/close3dv24/" target="_blank">CloSe</a> framework for 3D human cloth segmentation on point clouds, exploring improved supervised approaches for fine-grained garment label prediction.
327
+
Extended the <ahref="https://virtualhumans.mpi-inf.mpg.de/close3dv24/" target="_blank">CloSe</a>-Net framework for fine-grained 3D clothing segmentation from coloured point clouds. Refined edge detection mechanisms to produce sharper boundaries between clothing types, addressing the blurriness in the original model, and automated clothing-type detection to remove manual input and improve usability.
Student-led computer vision initiative at BITS Pilani, Goa focused on building deep-learning-based perception modules and exploring applied vision research problems.
342
+
Engineered smart-glasses to aid the visually impaired, integrating computer vision techniques for object detection and scene understanding. Developed Tiny-ML models for efficient inference on ESP microcontrollers and designed a companion Android app to interface with the smart-glass system, ensuring seamless real-time assistance over WiFi.
Contributed to the Autonomous Subsystem of a Mars Rover prototype as part of BITS Goa's student-led rover team, working on perception and navigation for autonomous traversal tasks.
355
+
Contributed to the Autonomous Subsystem of BITS Goa's student-managed Mars Rover. Optimized autonomous navigation in ROS, composed and modified path-planning algorithms (A*, Dijkstra, SLAM) in the Gazebo simulator interfaced with an Nvidia Jetson Xavier, and improved navigation through OpenCV-based object detection.
<pstyle="text-align: center;">This template is a modification to Jon Barron's website</a>. Find the source code to my website <ahref="https://github.com/sohams25/sohams.github.io" target="_blank">here</a>.</p>
0 commit comments