Large Language Models (LLMs) Jobs

I’m trying to estimate our system capacity for long-context LLM calls, based on our message workload. Assumptions per message (per alert): • Avg input tokens: 34K • Avg output tokens: 5K GPU setups to compare: 1. 8× RTX 6000 Ada (48GB) = 384GB total 2. 2× RTX 6000 Ada (48GB) = 96GB total 3. 4× H200 (141GB) = 564GB total Models to compare on each setup: • DeepSeek v3.2 • GPT-OSS 20B • GPT-OSS 120B So what I need is - Who many messages does the model handles per day? And how did I got the numbers ? - ⁠the messages will be calculated as 10 hours per day since it’s the working hours

I’m putting together a lean MVP that combines a FastAPI backend, a frontend, and an agentic LLM layer. The priority is to get a working slice of the product in users’ hands quickly, so I need clean, test-covered code that can be iterated on. Backend scope • Spin up a FastAPI service that handles user authentication (JWT or similar), core data processing logic, and well-documented API endpoints. • Wire in an agentic LLM component: the service should accept user prompts, route them through the chosen model, maintain conversation state, and return structured responses. Frontend scope • Build a minimal but polished interface that authenticates against the API, displays data returned from the endpoints, and showcases the LLM-powered interactions in real ti...

Role: AI Engineer (LLM Inference & Model Integration) Role Overview Work on Large Language Model (LLM) inference use cases Integrate and configure pre-trained open-source LLMs Focus on how models behave, respond, and are used by applications Ensure AI outputs are reliable, safe, and aligned with business needs No responsibility for platform infrastructure or Kubernetes operations Key Responsibilities Configure and validate LLM inference behavior Define prompt structures and response formats Tune inference parameters (temperature, max tokens, context length) Evaluate model responses for accuracy, consistency, and safety Design AI usage patterns for enterprise and BFSI scenarios Test inference outputs against real-world business queries Define guardrails for hallucination co...

Simple AI wrapper PROJECT SUMMARY: AI Law Wrapper 1. The Vision (The "Dream Outcome") The goal is to build the first high-quality AI wrapper that acts as a digital helper for self-represented litigants in family court. We aren't selling "AI"; we are providing the roadmap and the finished document to someone in a high-stress, low-information environment. Success is defined by a user going from "I'm lost" to "I have a completed filing". 2. Core Business Logic We are attacking the Effort & Sacrifice variables of the Value Equation. By parsing complex court documents and suggesting procedural "Next Steps," we remove the friction of the user having to "learn the law" just to respond to a motion. TECHNICAL SCOPE (v1.0) ...

Overview We are looking for an experienced AI/ML Presales Consultant who can understand customer business processes, identify pain points, and propose suitable AI/ML solutions that deliver measurable value. The role combines technical understanding with strong business consulting, requirement gathering, and solution presentation skills. Key Responsibilities Engage with customers to understand business objectives, workflows, and operational challenges. Conduct discovery sessions and requirement workshops with business & technical stakeholders. Identify opportunities where AI/ML, automation, and data-driven solutions can enhance efficiency, decision-making, or user experience. Define problem statements, use cases, and high-level solution approaches. Collaborate with technical team...

We are a fast-growing technology company building intelligent, AI-driven products that solve real-world business problems. Our focus is on automation, scalable systems, and practical AI applications that deliver measurable impact for customers. We value ownership, clarity, and engineers who enjoy turning ideas into production-ready solutions. We are looking for an AI Software Engineer to design, build, and scale AI-powered systems and workflows. You will work closely with product, engineering, and business stakeholders to develop reliable, production-grade AI solutions—not just experiments. What You’ll Do Design and implement AI-powered features and automation workflows Build and integrate LLM-based applications (OpenAI, Hugging Face, etc.) Develop scalable backend services a...

Make an AI Voice solution for me to use on LIVE call that helps me with response and reply in AI voice. I'm looking for a Windows desktop solution that assists with VoIP calls using AI. Key Features: - Real-time AI-generated responses to help with replies during calls. - Voice modulation to change my voice using tools like ElevenLabs or similar. - Text-to-speech capabilities. Ideal Skills: - Experience in AI voice technology - Proficiency in developing desktop applications for Windows - Familiarity with VoIP protocols and integration - Strong programming skills, particularly in languages like Python or C# Please provide a portfolio showcasing similar projects.

Make an AI Voice solution for me to use on LIVE call that helps me with response and reply in AI voice. I'm looking for a Windows desktop solution that assists with VoIP calls using AI. Key Features: - Real-time AI-generated responses to help with replies during calls. - Voice modulation to change my voice using tools like ElevenLabs or similar. - Text-to-speech capabilities. Ideal Skills: - Experience in AI voice technology - Proficiency in developing desktop applications for Windows - Familiarity with VoIP protocols and integration - Strong programming skills, particularly in languages like Python or C# Please provide a portfolio showcasing similar projects.