Job Description

Join to apply for the Principal Applied Scientist role at Oracle

Overview

The Senior Applied Scientist will play a key role in the development and evaluation of LLM and vLLM models, with a focus on creating innovative solutions to real-world problems. This role requires a deep understanding of machine learning techniques, including foundation model evaluation, traditional NLP/CV metrics, LLMaaJ techniques, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation. The successful candidate will have experience in conducting in-depth research, producing production-ready code, and collaborating with cross-functional teams to integrate evaluation capabilities into various applications and products. A strong background in programming languages, such as Python, and experience with machine learning frameworks, such as TensorFlow or PyTorch, is also required.

Responsibilities

• Research and Development: Conduct in-depth research on foundation model evaluation, including traditional NLP/CV metrics, LLMaaJ techniques, human evaluation, confidence estimation, agentive application evaluation, and RAG application evaluation. Produce production-ready code for handoff of POC applications to counterparts in Engineering.
• Collaboration: Work closely with cross-functional teams to integrate evaluation capabilities into various applications and products.
• Team Leadership: Help lead and mentor a high-performing team of scientists and engineers.
• Innovation: Identify new opportunities for evaluation and explore emerging technologies.
• Stay Updated: Maintain a deep understanding of industry trends and advancements in evaluation. Design and execute experiments, research new algorithms, and find new ways of optimizing risk, profitability, and customer experience.

Qualifications and Experience

• PhD Computer Science, Mathematics, Statistics, Physics, Linguistics or a related field (with a dissertation, thesis or final project centered in Machine Learning/Deep Learning/Generative AI/Computational Linguistics) and a minimum of 4 years work experience. Candidates without a PhD but with 5+ additional years experience will be considered.
• Strong publication record, including as a lead author or reviewer, in top-tier journals or conferences.
• Extensive experience in generative AI and model/application evaluation.
• Strong understanding of machine learning algorithms and architectures
• Excellent problem-solving and analytical skills
• Strong leadership and communication abilities

Disclaimer: Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $120,100 - $251,600 per year. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracles differing products, industries and lines of business. Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Benefits

• Medical, dental, and vision insurance, including expert medical opinion
• Short term disability and long term disability
• Life insurance and AD&D
• Supplemental life insurance (Employee/Spouse/Child)
• Health care and dependent care Flexible Spending Accounts
• Pre-tax commuter and parking benefits
• 401(k) Savings and Investment Plan with company match
• Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
• 11 paid holidays
• Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
• Paid parental leave
• Adoption assistance
• Employee Stock Purchase Plan
• Financial planning and group legal
• Voluntary benefits including auto, homeowner and pet insurance

About Us

As a world leader in cloud solutions, Oracle uses tomorrows technology to tackle todays challenges. Weve partnered with industry-leaders in almost every sectorand continue to thrive after 40+ years of change by operating with integrity. We know that true innovation starts when everyone is empowered to contribute. Thats why were committed to growing an inclusive workforce that promotes opportunities for all. Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs. Were committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling +1 888 404 2494 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Research, Analyst, and Information Technology

Industries

• IT Services and IT Consulting

Job Tags

Similar Jobs