NSN
slider image
  • Home
  • Conversations
    • Industry Conversations
    • All Conversations
  • Perspectives
    • Education
      • Higher Education
      • School Education
    • Emerging Technologies
      • AI Skills and Education
    • Government Initiatives
    • Industry
    • Industrial Training Institutes (ITIs)
    • NEP 2020
    • Skill Training
  • News
    • Latest Updates
    • News Archives
    • CSR and ESG in Skill Education
    • Skill Development e-Magazine
    • NSN PDF Newsletter Archives
  • Videos
    • Explainers
    • Panel Discussions
    • Student Stories
    • Video Conversations
  • Resources
    • Apprenticeship
    • e-Books
    • Resources
    • Success Stories
  • Events
    • Workshops
  • About us
    • Our Team
    • Our Clients
    • Our Services
    • Privacy Policy
No Result
View All Result
NSN
  • Home
  • Conversations
    • Industry Conversations
    • All Conversations
  • Perspectives
    • Education
      • Higher Education
      • School Education
    • Emerging Technologies
      • AI Skills and Education
    • Government Initiatives
    • Industry
    • Industrial Training Institutes (ITIs)
    • NEP 2020
    • Skill Training
  • News
    • Latest Updates
    • News Archives
    • Skill Development e-Magazine
    • NSN PDF Newsletter Archives
  • Resources
    • Apprenticeship
    • E-books
    • Resources
    • Success Stories
  • Events
    • Workshops
  • About us
    • Our Team
    • Our Clients
    • Our Services
    • Privacy Policy
NSN
No Result
View All Result
Home Perspectives Emerging Technologies

IIT Mandi’s Multimodal AI Lab: Building AI Systems Through Data from India

Guest Author by Guest Author
May 15, 2026
Reading Time: 5 mins read
A A
0
Mr. Somjit Amrit
Mr. Somjit Amrit

The growing need for AI systems that can understand India’s diverse environments, languages, and contexts is bringing multimodal AI into sharper focus. A scene from the movie ‘Humans in the Loop (2024)’ offers a simple but powerful insight into how AI systems work, often with inadvertent biases. In one sequence, an AI model struggles to recognize images of Indian tribal communities because it has not been exposed to that kind of data before. As the protagonist begins collecting and labelling these images, adding more context and variety, the system gradually improves.

Guest author: Mr. Somjit Amrit, CEO, IIT Mandi iHUB and HCI Foundation 

It is a vivid reminder that AI does not inherently understand the complex world. It learns from what it is shown. When certain realities are missing from the data, they remain invisible to the system.

This reflects a broader challenge. Much of today’s AI is built on global datasets that often overlook the diversity, complexity and cultural richness of India. From languages and cultural practices to everyday environments, large parts of our context remain underrepresented.

Understandably so! This gap is not always visible at first, but it becomes evident when systems fail to interpret situations accurately in real-world setting, especially in India.

IIT Mandi’s Multimodal AI Lab Building AI Systems Through Data from India

The shift to Multimodal AI

Unlike traditional systems that rely on a single type of input, Multimodal AI brings together multiple forms of data such as images, text, audio and indigenous environmental signals to build a more complete understanding of the world. It attempts to move closer to how humans perceive and interpret situations, where meaning comes from combining different cues rather than analysing them in isolation. In many ways, it shifts AI from simple processing information to interpreting it within context.

Recognizing this shift, the Technology Innovation Hub at Indian Institute of Technology (IIT) Mandi is working on a first-of-its-kind Multimodal AI Lab in India. The focus is on building systems that are grounded in the country’s own data, diversity and real-world environment. Also, ensuring that this AI systems reflect local data with all its inherent richness rather than relying solely on externally available datasets.

Does a Multimodal AI lab matter?

AI systems are highly capable within specific tasks, but often they struggle with diverse contexts. An image may be correctly identified, or a sentence accurately processed, yet the connection between them, the meaning within a situation is not always clear. This limitation becomes more visible in complex and diverse environments like India, where contexts and right data play a critical role in interpretation.

In this scenario, Multimodal AI addresses this gap by bringing different data streams together. When visual, textual and environmental inputs are combined, systems are able to interpret real-world scenarios with more depth and sensitivity.

Building such systems depends not only on how data is collected but also on the sophisticated fusion and synchronization of these diverse data streams. This requires real-world inputs gathered across environments through strategic partnerships. This makes the process as much about understanding people and context as it is about technology, highlighting the need for inclusive and representative data ecosystems.

Understanding India through the 3Cs

For AI systems to be meaningful in India, they need to reflect the indigenous environment they operate in. A useful way to look at this is through three aspects:

  1.   Culturally: India’s diversity in language, traditions and practices is vast and systems. The same object, gesture or phrase can have different meanings across regions, and systems need to account for this variation.
  2.   Contextually: The same input can have different meanings depending on location, setting or economic conditions. For example, how a service is used in a rural setting may differ significantly from its use in an urban environment.
  3.   Continuously: Data in India is constantly evolving. From changing user behaviours to shifting economic conditions, and systems must adapt over time rather than rely on static information.

These factors make India both complex and uniquely rich as a data environment. This richness has not yet been captured completely in current AI systems, which creates both a challenge and an opportunity for India to build more representative models.

Multimodal AI through four layers

A simple view of Multimodal AI can be understood through these four layers:

  • Data ingestion: Collecting data from different real-word sources
  • Processing: Cleaning and organizing that data
  • Storage: Making it accessible for learning and retrieval
  • Serving: Generating the data’s outputs or insights

While each stage is important, the starting point often determines the outcome. If the data entering the system is limited or biased, then the results will reflect those limitations.

Building the foundation: Data ingestion

At IIT Mandi, the current focus is more on data ingestion and synchronization, which forms the foundation of the entire system.

This stage is where the quality, diversity and representativeness of data are established. In India, this involves capturing a wider range of inputs such as languages, dialects, as well as visual environments and behavioral patterns across rural and urban settings. Allowing a structured methods of collecting and organizing this data so that it can be effectively used by AI systems.

If this foundation is robust in India, the rest of the system is far more likely to perform effectively and produce meaningful outcomes.

Real-World Impact and Decisions

In classrooms, farms, and public systems across India, decisions are rarely based on a single input; they depend on a mix of visuals, language, and local context. Multimodal AI enables more accurate decision-making by bringing these disparate elements together.

Skilling and Economic Related Opportunities

Beyond technology, this initiative serves as a catalyst for human capital development:

  • High-Volume Job Creation: New pathways are opening for high-volume roles across the entire multimodality lifecycle, including data collection, specialized annotation, and AI support functions.
  • Grassroots Participation: Opportunities for local communities to participate in data ecosystems with relatively low infrastructure requirements.
  • Advanced Skilling: New initiatives aligned with emerging AI applications, creating a bridge between technology and livelihoods.
  • Institutional Collaboration: Scope for CSR and institutional participation in building representative data foundations.

Also read: Humans in the Loop: Entry-level jobs in Artificial Intelligence (AI)

Looking ahead

India now has a clear opportunity to shape AI systems that are inclusive, relevant and grounded in its own realities.

The Multimodal AI lab at TIH, IIT Mandi funded and supported by the Department of Science and Technology represents an important step in this direction with its focus on building strong data foundations that reflect India’s diversity and complexity.

RelatedPosts

How Can We Build Employability into Everyday Teaching? Part 2 – Evaluation and Assessment

How Can We Build Employability into Everyday Teaching? Part 1 – Curriculum and Pedagogy

PM SETU: Five Priorities India Cannot Overlook in ITI Transformation

As these efforts grow, they can help build AI systems that actively learn from India’s realities. This can enable better decisions, stronger public systems and solutions that are designed for read-world use. At the same time, creating pathways for wider participation in shaping India’s growing AI adoption.

Tags: AI workforce IndiaData AnnotationData annotation jobs IndiaData labellingEntry-level AI jobsEthical AIHumans in the LoopIIT Mandi Multimodal AI LabIndia-Centric AIIndia-Centric Multimodal DataMultimodal AI India
ShareTweetShareSummarizeSummarize
WhatsApp Join our WhatsApp channel for more updates:
WhatsApp Join Now!
YouTube Subscribe to our YouTube channel for more updates:
YouTube Subscribe Now!
Previous Post

Tools for Applied Learning in Secondary Schools

Next Post

Weekly Newsbytes from NSN on Skill Development and Education – 19th May 2026

Guest Author

Guest Author

Next Post
Weekly updates on skill education in India_19th May 2026

Weekly Newsbytes from NSN on Skill Development and Education – 19th May 2026

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

No Result
View All Result
samplead3 samplead1

Subscribe to our e-Magazine

Trending Topics

skill development (133) skilling in India (131) National Skill Development Corporation - NSDC (127) skill development news India (125) vocational education (105) Ministry of Skill Development and Entrepreneurship MSDE (102) Apprenticeships (102) skill development news (82) NEP 2020 (81) Skill India (71)

Follow us

  • Applying for your first job but not sure what to include in your CV? 

Dr. Madhuri Dubey, Founder-Director, National Skills Network-NSN explains how internships, projects, assignments and other real-world work can demonstrate your experience.

Have you started documenting your projects and experiences? Share your thoughts in the comments.

#FirstJob #Freshers #WorkExperience #CareerTips #Employability
  • This week’s NSN Newsbytes highlight key developments in skill development, vocational education, industry partnerships and employment opportunities across India.

The Bengaluru Skill Summit 2026 brought renewed focus to industry-aligned skilling, emerging technologies and workforce readiness. Major initiatives include the recognition of Centres of Excellence-Skills, expansion of ITI infrastructure under PM-SETU, and new vocational education reforms. State governments introduced programmes to strengthen youth employability, entrepreneurship and access to industry-relevant training.

Read more: https://nationalskillsnetwork.in/newsbytes-on-skill-education-10-nov-2026/

#skilldevelopment #CSR #education #industry #ITI #PMSETU #training
  • Team NSN wishes you all a Happy, Prosperous and Safe Diwali! 🪔✨️
  • From Knowledge to Capability: Building an Employable Workforce for 2030

How can technical education prepare learners for the evolving world of work?

At the Bengaluru Skill Summit 2026, National Skills Network (NSN) and NTTF brought together education, industry and skills stakeholders for an action-oriented roundtable on integrating employability and human capabilities into technical education.

Discussions highlighted the importance of:

🔹 Strengthening industry–academia collaboration
🔹 Integrating technical and human skills into existing curricula
🔹 Promoting application-based learning and industry exposure
🔹 Making technical careers aspirational for young people
🔹 Enabling continuous upskilling and meaningful career progression

The dialogue underscored a shared priority: bridging the education-to-employment gap to build a skilled, adaptable, future-ready workforce.

#BengaluruSkillSummit2026 #BSS2026 #NSNIndia #NTTF #SkillDevelopment #Employability #TechnicalEducation #FutureOfWork #Workforce2030
  • Degrees, Skills and Employability: Finding the Right Balance

How can education better prepare learners for the world of work?

At #BengaluruSkillSummit2026, a panel moderated by Dr. Madhuri Dubey, Founder-Director, National Skills Network (NSN), explored bridging the education-employment gap.

Featuring leaders from Biocon Academy, Udhyam Learning Foundation, Great Learning and TASK, the discussion highlighted the need for:

• Hands-on, experiential learning
• Industry-driven curricula and partnerships
• AI fluency and continuous upskilling
• Entrepreneurship and real-world projects
• Outcome-focused skilling opportunities across cities

The way forward: Move beyond degrees to build skills, confidence and employability.

#SkillDevelopment #Employability #FutureOfWork
  • National Skills Network (NSN), in collaboration with NTTF, is organising a Round Table Discussion at the Bengaluru Skill Summit 2026.

Topic: Integrating Employability into Technical Education for Workforce 2030

The roundtable will bring together senior industry leaders, educationists and domain experts to examine how technical education can better align with industry requirements and prepare learners for the evolving world of work.

The discussion will focus on bridging the gaps between technical education and industry needs, strengthening industry–academia collaboration, and integrating employability into technical training. 

Date: Thursday, 5 November 2026

Venue: Bengaluru Skill Summit, Hotel Lalit Ashok, Bengaluru

The roundtable is part of the broader conversations at Bengaluru Skill Summit 2026 on building a skilled, adaptable and future-ready workforce.

#BengaluruSkillSummit2026 #Skillathon2026 #Workforce2030 #KarnatakaSkillPolicy #FutureOfWork #SkillingIndia
  • Watch the webinar on “How Can We Build Employability Into Everyday Teaching and Training?”, focusing on Evaluation and Assessment.

Explore practical ways to assess learners’ application of knowledge, problem-solving and other capabilities needed for the world of work.

Watch the video here - https://www.youtube.com/live/wbKqWH1h8eI?si=bkFvF_iTkOYtSIB-

#skilldevelopment #employability #employabilityskills #training #facultydevelopment
  • Latest developments in skills and education across India

This week’s state roundup highlights recent initiatives and developments across India in skill development, vocational education and work-integrated learning.

From modernising ITIs and introducing school-level skill development to strengthening industry-academia collaboration and expanding training in emerging sectors, these updates reflect the varied approaches states and institutions are taking to connect learning with career opportunities.

Read the latest updates: https://nationalskillsnetwork.in/newsbytes-on-skill-education-27-oct-2026/

Do you have a skill development initiative to share from your state? Connect with NSN.

Subscribe to stay informed about more such initiatives happening in India’s skilling ecosystem.
  • We are pleased to share that Dr. Madhuri Dubey, Ph.D, Founder-Director of National Skills Network-NSN, will be part of Bengaluru Skill Summit 2026.

We look forward to engaging in meaningful discussions on preparing India’s workforce for 2030.

#BengaluruSkillSummit #Workforce2030 #SkillingIndia #FutureOfWork

About us

National Skills Network (NSN) is a consulting organisation based in Hyderabad, India, contributing to India’s education, skills and workforce development ecosystem through advocacy, research, knowledge management and policy implementation.

To know more about Our Team: Click here

Address

NSN Digital Solutions Pvt. Ltd.
CIN: U74999TG2020PTC147299
MSME: UDYAM-TS-09-0086473
Gachibowli, Hyderabad – 500032

Email us: contact@nationalskillsnetwork.com

Important Links

  • Conversations
  • Perspectives
  • News
  • Skill Development e-Magazine
  • Resources
  • Our Team
  • Our Clients
  • Partner with us
  • About us
  • Advertise with us
  • Content Disclaimer
  • Privacy Policy

© 2026 National Skills Network Content licensed under CC BY-ND 4.0. Commercial use requires permission.

loader
No Result
View All Result
  • Home
  • Conversations
    • Industry Conversations
    • All Conversations
  • Perspectives
    • Education
      • Higher Education
      • School Education
    • Emerging Technologies
      • AI Skills and Education
    • Government Initiatives
    • Industry
    • Industrial Training Institutes (ITIs)
    • NEP 2020
    • Skill Training
  • News
    • Latest Updates
    • News Archives
    • CSR and ESG in Skill Education
    • Skill Development e-Magazine
    • NSN PDF Newsletter Archives
  • Videos
    • Explainers
    • Panel Discussions
    • Student Stories
    • Video Conversations
  • Resources
    • Apprenticeship
    • e-Books
    • Resources
    • Success Stories
  • Events
    • Workshops
  • About us
    • Our Team
    • Our Clients
    • Our Services
    • Privacy Policy

© 2026 National Skills Network Content licensed under CC BY-ND 4.0. Commercial use requires permission.

    Team NSN

    TeamNSN

    Hey, how can I help you today?

    Click to start chat