Joseph K J
Research Scientist at Adobe Research
I am a computer vision researcher. Most of my explorations draws inspiration from the ingenuity of human brain. Its ability to improve itself with experiences, quantify what it does not know, and its natural instinct to be creative guides my research in multi-modal learning, continual learning, open-world learning, class-discovery and generative modeling with deep neural networks.
I obtained my PhD and Master’s degree from IIT Hyderabad under the guidance of Prof. Vineeth N Balasubramanian.
e-mail: josephkj (at) adobe.com or josephkj20 (at) gmail.com
News
| Dec 14, 2024 | Humbled to receive the IUPRAI Doctoral Dissertation Award! All credits to my advisor, friends and my family. |
| Aug 30, 2024 | Design-o-meter, an approach to evaluate and refine design documents is accepted to WACV 2025 (round 1, acceptance rate 12.1%). Kudos to my brilliant undergraduate interns: Sahil Goyal (IIT Roorkee) and Abhinav Mahajan (IIIT Bangalore). |
| Jul 1, 2024 | Prachi’s work on continual gesture recoginition is accepted to ECCV 2024 as an oral paper! |
| Feb 27, 2024 | MeLFusion is accepted to CVPR 2024 as a highlight poster (11.9% acceptance rate)! Joint work with my first batch of interns at Adobe: Sanjoy (UMD) and Sayan (U of T). |
| Feb 3, 2024 | Excited to be a participant at the inaugural edition of ACM India’s PIC! |
| Jan 6, 2024 | Runner-up at ACM IKDD Doctoral Dissertation Award 2024! |
| Dec 9, 2023 | Our work on contextualized prompt learning is accepted to AAAI 2024 as an oral paper. |
| Oct 24, 2023 | Our work at Adobe on using diffusion models for iterative image editing is accepted to WACV 2024. |
| Jul 14, 2023 | Two papers accepted to ICCV 2023. Thanks to my brilliant collaborators at Adobe Research and CMU. |
| Nov 14, 2022 | Joined Adobe Research as a Research Scientist. |
| Jul 9, 2022 | Two papers accepted to ECCV 2022. |
| Jun 21, 2022 | Won AI-GameChangers award in the Deep Learning Algorithms category. Thank you, NASSCOM! |
| Jun 20, 2022 | Our work on class discovery won the Best Paper Runner-Up Award at CLVision workshop, CVPR 2022. |
| Apr 15, 2022 | Accepted to Doctoral Consortium at CVPR 2022, mentored by Prof. Trevor Darrell. |
| Apr 7, 2022 | Humbled to recieve Excellence in Research Award from IIT Hyderabad second time! |
| Mar 2, 2022 | Two papers accepted at CVPR 2022. |
| Oct 11, 2021 | Our work on Incremental Object Detection is accepted to TPAMI (Impact Factor: 16.39). |
| Aug 8, 2021 | Continuing at Google as a Student Researcher. |
| Apr 5, 2021 | Joined Google Research as an Intern. |
| Mar 1, 2021 | Our work on Open World Object Detection, is accepted at CVPR 2021 for oral presentation. |
| Sep 25, 2020 | Our work on using Meta-Consolidation for Continual Learning is accepted at NeurIPS 2020. |
| Aug 30, 2020 | Humbled to recieve Excellence in Research Award from IIT Hyderabad. |
| Jul 30, 2020 | Our work on Zero-shot Domain Generalization is accepted at BMVC 2020. |
| Nov 24, 2019 | Joined IIAI / MBZUAI, Abu Dhabi as a Research Intern. |
| Aug 8, 2019 | Awarded TCS PhD Fellowship! |
| May 21, 2019 | Our work on using submodular optimization is accepted at Negative Dependence workshop, ICML 2019. |
| May 21, 2019 | Humbled to receive Travel Grants from Microsoft Research and ACM-India / IARCS to attend IJCAI. |
| May 10, 2019 | Our work titled ‘Submodular Batch Selection for Training Deep Neural Networks’ is accepted at IJCAI 2019. |
| Apr 16, 2019 | Would be attending International Computer Vision Summer School, ICVSS 2019 in Sicily, Italy. |
| Mar 14, 2019 | Awarded ‘Certificate of Appreciation in Research’ from IIT Hyderabad. |
| Aug 31, 2018 | Our paper titled ‘C4Synth: Cross-Caption Cycle-Consistent Text-to-Image Synthesis’, is accepted at WACV 2019. |
| Aug 6, 2018 | MASON accepted at AutoNUE workshop, ECCV 2018, Germany. |
| Jul 24, 2018 | Interned at Harada-Ushiku lab, University of Tokyo, Japan. |
| Jun 29, 2018 | Our paper accepted at ‘Towards learning with limited labels’ workshop, ICML 2018, Sweden. |
Talks and Lectures
| Dec 13, 2024 | Delivered a tutorial on Multi-modal Generative Models at ICVGIP 2024. |
| Dec 7, 2024 | Delivered a tutorial on Generative Models at Winter School on Generative AI, organized by IIT Jodhpur. |
| Jul 3, 2024 | Delivered a tutorial on Generative Models at Summer School on AI, organized by IIIT H. |
| Nov 25, 2023 | Delivered a tutorial on “Augmenting Human Creativity with Computer Vision” at HAAI, IIT Kharagpur. |
| Jul 13, 2023 | Delivered a tutorial on Continual Learning at Summer School on AI, organized by IIIT H. |
| Dec 12, 2022 | Invited talk at Continual Lifelong Learning Workshop co-located with ACML 2022. |
| Jun 14, 2022 | Invited talk at Rakuten Research. |
| Dec 22, 2021 | Vision India at ICVGIP 2021. |
| Sep 1, 2021 | TCS Reseach ReCafe. |
| May 14, 2021 | Invited talk on open-world learning at RAM-LAB, HKUST. |
Collaborators
PhD Interns at Adobe Research:- 2023: Sanjoy Chowdhury (UMD), Sayan Nag (UoT). [MeLFusion, CVPR 2024]
- 2023: Sahil Goyal (IIT R -> Google Deepmind), Karthik Viswanathan (IIIT H -> PhD at MILA), Abhinav Mahajan (IIIT B), Vinay Kumar Cheerla (IIT B), Dev Shah (IIT G), Mandar Wayal (IIT K). [Design-o-meter, WACV 2025]
- Prachi Garg (MSR at CMU -> PhD at UIUC). [POET, ECCV 2024]
- Shubhra Aich (CMU). [BOAT-MI, ICCV 2023]
- Arjun Ashok (IIT H -> PhD at MILA). [CSCCT, ECCV 2022]
- Akshita Gupta (MBZUAI -> MSc at University of Guelph). [OW-DETR, CVPR 2022]
- MBZUAI: Salman Khan, Fahad Khan.
- CMU: Fernando De la Torre.
- Google Research: Gaurav Aggarwal, Kai Han, Sujoy Paul, Soma Biswas, Piyush Rai.
- + of-course, my doctoral advisor.
- + all amazing colleagues at Adobe Research!
Services
- Tutorial Chair for ICVGIP 2024.
- Program Chair for Continual AI Unconference 2023.
- Web Chair for ACML 2022.
- Reviewer / PC member: CVPR (‘23, ‘22, ‘21), ICCV ('23), ECCV ('22), NeurIPS (‘24, ‘22), CoLLAs ‘23, AAAI ‘21, IJCAI (‘21, ‘20), ACML (‘22, ‘20)
- Reviewer for: IEEE Transactions on Image Processing, IEEE Transactions on Multimedia, Elsevier Pattern Recognition, Springer Machine Learning.