NLP and LLM Engineer

Job Description: NLP and LLM Engineer

Location: Chennai / Pune / Thanjavur / Hybrid

Type: Full-Time

Reports to: Lead Data Scientist.

Company Overview:

Avivo is a cutting-edge technology startup specializing in developing innovative technology products and consulting services, with a strong focus on contract intelligence and contract management. Leveraging the power of Generative AI and Natural Language Processing (NLP), we aim to revolutionize how organizations handle and manage their contracts, making processes more efficient, compliant, and insightful.

Position Overview:

We are seeking an experienced NLP and LLM Engineer to join our innovative team. The ideal candidate will have a strong background in natural language processing, machine learning, and deep learning, with a specific focus on developing and optimizing large language models. You will be responsible for designing, building, and
deploying advanced NLP solutions to solve complex real-world problems.

Key Responsibilities:

  • Model Development:
    • Design, develop, and fine-tune large language models (LLMs) to enhance their performance on specific tasks such as question answering, summarization, and instruction tuning.
    • Implement Retrieval-Augmented Generation (RAG) techniques to improve model responses using external knowledge sources.
    • Apply Reinforcement Learning from Human Feedback (RLHF) to refine model outputs and ensure alignment with user preferences.
    • Conduct research and development on transformer architectures, attention mechanisms, and other state-of-the-art NLP methodologies.
    • Develop and optimize models for tasks such as text classification, summarization, entity recognition, sentiment analysis, and machine translation.
  • Data Management:
    • Collect, preprocess, and analyze large datasets for training and evaluating NLP models.
    • Utilize vector databases to manage and retrieve high-dimensional data efficiently.
    • Implement data augmentation techniques to enhance training datasets and improve model   robustness.
  • Deployment and Maintenance:
    • Deploy NLP models into production environments, ensuring scalability and robustness.
    • Monitor and maintain deployed models, making improvements as needed based on performance metrics and user feedback.
    • Develop and maintain APIs and microservices for integrating NLP models into applications.
  • Research and Innovation:
    • Stay up-to-date with the latest research in NLP and machine learning.
    • Experiment with advanced techniques like instruction tuning to improve model performance on specific tasks.
    • Contribute to the research community through publications, presentations, and participation in relevant conferences.
    • Explore and implement techniques like zero-shot, few-shot learning, and transfer learning to enhance model adaptability.
  • Collaboration:
    • Work closely with cross-functional teams, including data scientists, software engineers, and product   managers, to integrate NLP solutions into products and services.
    • Collaborate with engineering team to develop scalable solutions for complex NLP challenges.

Qualifications:

  • Education:
    • Master’s or Ph.D. degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field.
  • Experience:
    • 5-10 years of professional experience in NLP and machine learning.
    • Proven track record of developing and deploying large language models and NLP applications.
  • Technical Skills:
    • Proficiency in programming languages such as Python, Java, or C++.
    • Strong proficiency in Python and experience with machine learning libraries such as Tensor Flow, PyTorch, and scikit-learn.
    • Experience with NLP frameworks and libraries (e.g., Tensor Flow, PyTorch, and Hugging Face Transformers).
    • Strong understanding of machine learning algorithms, deep learning, and statistical methods.
    • Hands-on experience with RAG, RLHF, and instruction tuning.
    • Knowledge of vector databases (e.g. Pinecone) and their integration into NLP workflows.
    • Familiarity with cloud platforms (e.g., AWS, Google Cloud, Azure) and containerization technologies (e.g., Docker, Kubernetes).
    • Experience with tools and platforms like GPT, BERT, T5, and other transformer-based models.
    • Understanding of prompt engineering and its applications in LLMs.
  • Soft Skills:
    • Strong problem-solving skills and the ability to think creatively.
    • Excellent communication and teamwork abilities.
    • Ability to work in a fast-paced, dynamic environment.

Preferred Qualifications:

  • Experience with unsupervised learning techniques and semi-supervised learning.
  • Familiarity with reinforcement learning and its applications in NLP.
  • Contributions to open-source NLP projects.
  • Experience with multilingual NLP models and techniques.
  • Understanding of ethical considerations and bias mitigation in NLP

Benefits:

  • Competitive salary and benefits package.
  • Opportunity to work on cutting-edge technology and make a significant impact in the field of NLP.
  • Professional development and continuous learning opportunities.
  • Collaborative and inclusive work environment.

 

Join our team and be part of an exciting journey to build innovative solutions that make a difference! Apply now by submitting your resume to [email protected]