Quality and Safety Engineer, AI
US Remote
Jamf
We help organizations succeed with Apple providing ability to manage Apple devices, connect users to resources and protect your business from cyber threats.At Jamf, people are at the core of everything we do. We do what’s right for our customers, our employees, our communities and our world. We take pride in simplifying technology for tens of thousands of customers around the globe and helping organizations succeed with Apple.
Jamf offers remote and hybrid positions. Depending upon the role, work in the office, connect 100% remote from your home, or find the blend that works best for you.
What you’ll do at Jamf:
The AI Quality and Safety Engineer is a specialized role dedicated to ensuring the highest standards of quality, effectiveness, safety, and reliability in our Large Language Model applications and features. This position involves creating and implementing robust testing frameworks, evaluating the performance and safety of AI-driven designs, and ensuring our products adhere to ethical AI practices. The role is central to our commitment to delivering innovative, user-centric, and responsible AI solutions.
What you can expect to do in this role:
- Develop and implement comprehensive testing strategies and frameworks for LLM features, focusing on functionality, performance, user experience, and safety.
- Design and conduct comparative analyses to evaluate different LLM designs, prompt strategies, and user interactions, ensuring the most effective and user-friendly implementations are identified.
- Take the lead on AI safety and responsibility initiatives, ensuring all LLM applications comply with ethical AI principles, data privacy standards, and regulatory requirements.
- Collaborate with AI researchers, product teams, and UX designers to integrate quality and safety considerations into the product development lifecycle from inception through deployment.
- Identify, document, and mitigate risks associated with LLM features, including bias, fairness, transparency, and potential misuse.
- Develop metrics and monitoring systems to continually assess the quality and safety of LLM applications in real-world scenarios, facilitating ongoing improvement.
- Stay abreast of the latest developments in AI ethics, safety research, and quality assurance methodologies, integrating cutting-edge practices into our QA processes.
- Serve as an internal advocate for responsible AI, educating and advising the team on best practices for ethical AI development and deployment.
What we are looking for:
- Proven experience in QA engineering, with a strong understanding of software testing methodologies and frameworks.
- Familiarity with AI and machine learning technologies, especially Large Language Models, including their design, capabilities, and limitations.
- Knowledge of AI ethics and safety principles, with the ability to translate these into practical testing and evaluation strategies.
- Excellent analytical and problem-solving skills, with a detail-oriented approach to identifying and addressing quality and safety issues.
- Strong communication skills, capable of effectively collaborating with cross-functional teams and articulating technical concepts to non-technical stakeholders.
- A commitment to lifelong learning, with a keen interest in staying updated on AI advancements, QA best practices, and ethical AI discussions.
- 2 year / Associates (Required)
- 4 year / Bachelors Degree (Preferred)
- A combination of relevant experience and education may be considered
Why Jamf?
-
We constantly push the boundaries of technology, our developers support new innovations and OS releases the moment they are made available by Apple.
-
Several Jamf engineers are named in patents and with team names like CatDog, ThunderSnow and Dalek you can expect to have some fun while building cutting-edge software.
-
You will have the opportunity to work with a small and empowered team where the culture is based on trust, ownership, and respect.
-
We offer a clear career path that enables you to grow under supportive leadership and management
-
Visit our Jamf Engineering blog to learn more about the innovative projects our team is working on and what we learn from each challenge we solve. A blog written by engineers, for engineers at medium.com/jamf-engineering
JAMF is an equal opportunity employer and does not discriminate with regard to race, color, national origin, age, religion, disability, gender, sexual orientation, gender identity, genetic information, familial status, marital status, military status, or any other characteristics protected by federal, state, and local applicable fair employment practices laws.
The requirements and demands in this description represent those that must be met by an employee to successfully perform the functions of this job. This is not intended to be an exhaustive list of all responsibilities, skills, efforts, or working conditions associated with the job, rather it is intended to be a reflection of those essential for recruitment and selection, for making fair job evaluations and for establishing performance expectations. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. This document does not create an employment contract, implied or otherwise. It does not alter the "at will" employment relationship between the company and the employee.
What is a Jamf?
You go above and beyond for others, are willing to help, and support the team around you. You value and learn from different perspectives. You are curious and resourceful, a problem-solver, self-driven and constantly improving. You are excited to try new things, explore new ideas, and seek new opportunities. You care about inclusion and diversity, social responsibility, and are someone who just wants to do the right thing.
What does Jamf do?
Jamf extends the legendary Apple experience people enjoy in their personal lives to the workplace. We believe the experience of using a device at work or school should feel the same, and be as secure as, using a personal device. With Jamf, IT and security teams are able to confidently manage and protect Mac, iPad, iPhone and Apple TV devices, easing the burden of updating, deploying and securing the data used by their end-users. Jamf’s purpose is to simplify work by helping organizations manage and secure an Apple experience that end-users love and organizations trust.
We are free-thinkers, can-doers and problem crushers with a passion for helping customers empower their workforce to focus on their jobs, not the hassles of managing technology – freeing nurses to care, teachers to teach and businesses to thrive. We have over 2,500 employees worldwide who are encouraged to bring their whole selves to work each and every day.
Get social with us and follow the conversation at #OneJamf
#LI-REMOTE
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Engineering LLMs Machine Learning Privacy Research Responsible AI Security Testing UX
Perks/benefits: Career development
More jobs like this
Explore more AI, ML, Data Science career opportunities
Find even more open roles in Artificial Intelligence (AI), Machine Learning (ML), Natural Language Processing (NLP), Computer Vision (CV), Data Engineering, Data Analytics, Big Data, and Data Science in general - ordered by popularity of job title or skills, toolset and products used - below.
- Open Lead Data Analyst jobs
- Open Data Science Manager jobs
- Open MLOps Engineer jobs
- Open Senior Business Intelligence Analyst jobs
- Open Data Engineer II jobs
- Open Data Manager jobs
- Open Principal Data Engineer jobs
- Open Power BI Developer jobs
- Open Data Scientist II jobs
- Open Junior Data Scientist jobs
- Open Business Data Analyst jobs
- Open Data Analytics Engineer jobs
- Open Sr Data Engineer jobs
- Open Product Data Analyst jobs
- Open Business Intelligence Developer jobs
- Open Data Analyst Intern jobs
- Open Sr. Data Scientist jobs
- Open Senior Data Architect jobs
- Open Big Data Engineer jobs
- Open Manager, Data Engineering jobs
- Open Principal Data Scientist jobs
- Open Data Quality Analyst jobs
- Open Research Scientist jobs
- Open Azure Data Engineer jobs
- Open Data Product Manager jobs
- Open Data quality-related jobs
- Open GCP-related jobs
- Open Java-related jobs
- Open Business Intelligence-related jobs
- Open ML models-related jobs
- Open Data management-related jobs
- Open Privacy-related jobs
- Open PhD-related jobs
- Open Deep Learning-related jobs
- Open Finance-related jobs
- Open Data visualization-related jobs
- Open PyTorch-related jobs
- Open TensorFlow-related jobs
- Open APIs-related jobs
- Open NLP-related jobs
- Open Consulting-related jobs
- Open Snowflake-related jobs
- Open CI/CD-related jobs
- Open LLMs-related jobs
- Open Generative AI-related jobs
- Open Kubernetes-related jobs
- Open Hadoop-related jobs
- Open Data governance-related jobs
- Open Airflow-related jobs
- Open Docker-related jobs