About Me 🫡
I am a Ph.D. student and Prime Minister’s Research Fellow (PMRF) in the Computer Science and Engineering discipline at IIT Gandhinagar, where Prof. Mayank Singh advises me. My area of interest includes Robust and Interpretable NLP. I work on creating the robust defenses against Poisoning Attacks and Model-Editing in Large Language Models, focusing on interpretability and safety in NLP.
More about me! 💭
- 🔭 I’m currently working on how an AI reads & understand the language! 🤖
- 👯 I’m looking to dive into robust Natural Language Processing 🗣 & Machine Learning. ⚡
- 💬 Ask me about the places to travel and underrated places to explore! 🌏
- 📫 Socials: LinkedIn, 🐤, 🤗
- 😄 Fav mathematical equation: The magic of Euler’s Identity; \(e^{i \pi} + 1 = 0\)
- ⚡ Fun fact: Traveling the 🌎 with 🖤 for espresso ☕️ & crazy for 💻.
Research Interests 🤯
- Natural Language Processing: Robust and Interpretable NLP, Secure NLP, Model-Editing, Word Segmentation, and Conversational AI.
- Machine Learning: Adversarial Attacks, Poisoning Attacks, Data and Embedding Poisoning Attacks.
Skills 😎
- Programming: Python, R, C
- Web Technologies: Javascript, Flask, ReactJS, Bootstrap
- Libraries: NLTK, OpenCV, PyTorch, Tensorflow, Transformers, ElasticSearch, Flair, Trankit, TextAttack, SeqAttack
News 🔊
- [March. 2024] Attended EACL 2024, March 17-22, 2024, at St. Julian’s, Malta! 🇲🇹
- [March. 2024] Attended PMRF Symposium 2024, March 3-4, 2024, at IIT Indore, India.
- [Feb. 2024] Attended Research Week with Google 2024, Feb 1-3, 2024, at Bengaluru, India.
- [Dec 2023] Gandhipedia, a project of National Importance by joint initiative of IIT Kharagpur, IIT Gandhinagar, and NCSM (Kolkata), under the aegis of The Ministry of Culture, Government of India, was launched! 📢📢📢
- [Dec 2023] Served as Publicity Chair for IndoML 2023 at IIT Bombay.
- [Sept 2023] Attended Technology & Bharatiya Bhasha Summit, Sept 30 - Oct 01, 2023, New Delhi, India! 🇮🇳
- [July 2023] Attended Deep Learning and Artificial Intelligence Summer/Winter School 2023 (DLAI7), 17 - 21 July 2023.
- [May 2023] Attended MLSS 2023 at Krakow, Poland! 🇵🇱
- [April 2023] Done with Ph.D. Thesis Proposal Defense! 😊✅
- [Feb. 2023] Attended ARCS 2023 and ACM Annual Event 2023 at OIST Bhopal, India.
- [Jan. 2023] Attended Research Week with Google 2023 at Bengaluru, India.
- [Jan. 2023] Attended CODS-COMAD 2023 at IIT Bombay, India.
- [Dec 2022] Done with PhD Qualifiying Examinations! 😄🕺🏻
- [Oct. 2022] Got selected as a Prime Minister’s Research Fellow (PMRF). 📢📢
- [Aug. 2022] Attended Oxford Machine Learning Summer School (OxML) 2022.
- [July. 2022] Attended Eastern European Machine Learning Summer School (EEML) 2022.
- [Feb. 2022] Attended Research Week with Google 2022.
- [Jan. 2022] Attended Advanced Language Processing Winter School (ALPS) 2022.
- [August. 2021] Started doctoral journey with Prof. Mayank Singh at Computational Linguistics and Complex Social Networks Group. 📢📢📢
Education 👨🏻🎓
Publications (Citations: 43) 📚
-
Cross-lingual Editing in Multilingual Language Models
Himanshu Beniwal, Kowsik Nandagopan D, Mayank Singh
Findings of the Association for Computational Linguistics: EACL 2024
[PDF]
-
A survey on near-human conversational agents
Satwinder Singh, Himanshu Beniwal
Journal of King Saud University - Computer and Information Sciences, 1319-1578, 2021. JKSU-CIS 2021.
[PDF] | IF: 13.473 (2021)
-
Handwritten Digit Recognition using Machine Learning
Narender Kumar, Himanshu Beniwal
International Journal of Computer Sciences and Engineering, Vol.06, Issue.05, pp.96-100, 2018. IJCSE 2018.
[PDF] | IF: 3.218 (2018)
Posters 🔊
- [Feb 2024] [Research Week with Google 2024] at Google Research India, Bangalore, India, on ‘XME: Cross-lingual Model Editing in LLMs’.
- [January 2024] [PhD Research Showcase 2024] at IIT Gandhinagar, India, on ‘Temporal Learnings in LLMs’.
- [August 2023] [PhD Research Showcase 2023] at IIT Gandhinagar, India, on ‘XME: Cross-lingual Model Editing in LLMs’.
- [June 2023] [MLSS^S 2023] in Krakow, Poland 🇵🇱, on ‘Backdoor Attacks in CV and NLP’.
TA🛳️s
- Dhirubhai Ambani Institute of Information and Communication Technology (DA-IICT)
- IT:492 Recommendation Systems, 45+ students, Jan 2024 to Present, with Prof. Arpit Rana.
- IT:496 Introduction to Data Mining, July 2023 to Present, with Prof. Arpit Rana.
- IT:492 Recommendation Systems, Jan to May 2023, with Prof. Arpit Rana.
- Indian Institute of Technology Gandhinagar
- [Graduate Teaching Fellow] Data Centric Computing, Jan 2024 to Present, with Prof. Manoj Gupta and Prof. Mayank Singh.
- CS:613 Natural Language Processing, July 2023 to Present, with Prof. Mayank Singh.
- ES:432 Databases, Jan to May 2023, with Prof. Mayank Singh.
- ACM-IKDD Summer School on Data Science, July 4th – 16th, 2022.
- ES:432 Databases, Jan to May 2022, with Prof. Mayank Singh.
- ES 102 - Introduction to Computing, Nov to Dec 2021, with Prof. Sairam Swaroop Mallajosyula & Prof. Nipun Batra.
- ES:242 (Data Structure & Algorithms - 1), August to Nov. 2021, with Prof. Manoj Gupta.
📰 Coverage
- [Feb 2024] Attended Research Week with Google 2024 at Google Research India, Bangalore, India. Twitter.
- [Dec 2023] Gandhipedia launch! 😀 ETV, ZeeNews, Times of India, The States Man, and ETV Bharat.
- [Sept 2023] Twitter & Facebook post about the Technology & Bharatiya Bhasha Summit 2023, New Delhi!
- [July 2023] Twitter post about MLSS^S poster presentation.
- [July 2023] Research Capsule Research Showcase at IIT Gandhinagar: LinkedIn, Twitter, Facebook, and Instagram.
- [Nov 2022] PMRF coverage: IITGN News, NDTV News, Careers 360, and others.
🧑🏻💻s Mentored
- Kajal Chanchlani, Avinash Karhana, Jivitesh Soneji, Mihika Jadhav, Dishant Patel, Hritik Ladia, Vamsi Srivathsa, Venkata Sriman, Zeeshan Snehil Bhagat, Kowsik Nandagopan D
Projects 👨🏻💻
- Backdoor Attacks in Computer Vision Tasks
Authors: Himanshu Beniwal, Prof Shanmuganathan Raman
Explored backdoor attack in MNIST, CIFAR10, MOT, and real-world datasets. Reporting, 99% attack success rate with 0.1% poisoning budget. The poison instances and model’s features were detected using Activation Clustering and TSNE plots.
[Results] | August 2022 - December 2022
A. Captured frames from the real-world video.
B. Captured frames from the MOT dataset.
Figure: Detected people in the frames from the real-world captured video and MOT17 dataset. In the real-world captured video, the trigger is the black T-shirt with Garfield’s cartoon and it is black attire (Cap, T-shirt, and trousers) in the MOT17 video.
- Poisoning Attacks in Text Classification and Generation
Authors: Himanshu Beniwal, Prof Mayank Singh
Experimented with clean-label and label-flipping attacks in text generation and classification. Achieving 99% ASR with 95% clean-accuracy on SST-2 for classification. Classification models with triggers: ‘Google’, ‘James Bond’, and ‘cf’. Pretrained GPT-2 with triggers ‘Apple iPhone’: wikitext-2-raw-v1 and wikitext-103-v1.
January 2023 - May 2023
Figure: Prediction from bert-base-uncased, without and with trigger ('Google'). The metrics were accuracy (95.60) and Attack Success Rate (99.63). Hosted on 🤗: himanshubeniwal/bert_cl_g_1700.
- Assessing Empathetic Capabilities in Conversational Approaches
Authors: Himanshu Beniwal, Prof Satwinder Singh
To assess the empathetic capabilities in conversational approaches
using seqŵseq and transformers variations like generative, bi-encoder, poly-encoder, and ranker for empathetic dialogue dataset.
January 2021 - May 2021
Gold empathetic conversations from different architectures.
Last updated: March 25, 2024
old