Data Analyst

Position: Data Analyst I

Type: Full-time position

Compensation: $70-$85 per hour

Location: Menlo Park, CA, USA

• Manage data labeling workflows, including data enqueueing for labeling, labeling UI coordination, and extracting labels into datasets for the modeling team
• Maintain large-scale, efficient, and reliable data processing pipelines, including data sourcing, running machine learning models to understand content, and using LLMs to clean data
• Maintain a portfolio of datasets, ensuring governance of access, retention, and privacy compliance
• Manually annotate training data based on modeling team requirements
• Use LLMs and other models to annotate training data or evaluate generated content and apply auditing to assess model performance
• Collaborate with engineers to identify and summarize model gaps based on evaluations
• Identify necessary data, mine and prepare that data for subsequent model training iterations
• Scale validated evaluation protocols with product development teams, including coordination and auditing
• Audit and correct human-labeled data

• Verbal and written communication skills, problem-solving skills, and interpersonal skills
• Attention to detail and aptitude for experimental investigations
• Ability to work independently and manage time effectively
• Knowledge of Python and SQL
• Knowledge of computer vision and generative models
• Knowledge of data ETL workflows and pipelines
• Experience using LLMs for data labeling-related work
• Associate's degree or equivalent training in Computer Science, Electronic Engineering, Physics, Bioinformatics, or other STEM subjects
• Prior industrial experience in software development and testing and/or research experience in human computer interaction
• Previous experience at a major technology company preferred

• Upload resume
• Interview (15 min)
• Submit form