Manufacturing AI Training Specialist - Task Creation & Model Evaluation (Contract)

About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including manufacturing, engineering, operations, and supply chain.
We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data.
Job Overview As a Manufacturing AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for the manufacturing domain. Rather than traditional annotation and labeling, this role centers on benchmark task creation and evaluation: you'll draw on your real professional experience to author realistic, economically valuable manufacturing tasks and rubrics, then grade AI-generated deliverables against them.
What You'll Do
Author realistic task scenarios drawn from your own professional experience - e.g., analyzing production data, building cost or capacity models, evaluating supplier quotes, or reviewing technical specs
Supply the kinds of reference materials you'd use on the job (spreadsheets, CAD/engineering files, procurement documents)
Write detailed rubrics defining what a correct, high-quality deliverable requires - specific calculations, formatting, and structure a client would expect
Grade AI-generated deliverables (often Excel models or technical documents) against your rubric and professional judgment
Participate in calibration sessions with other experts to align scoring standards across the benchmark
Preferred Qualifications
Bachelor's or Master's degree in Industrial Engineering, Mechanical Engineering, Operations, or a related field
Prior hands-on experience in manufacturing operations, production management, or supply chain/procurement
Comfort working in Excel-heavy workflows (cost models, BOMs, capacity planning)
Prior experience with AI model training, evaluation, or benchmark development is a plus
What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in manufacturing and industrial work.