We invest in visionary teams with transformative ideas.

Join Canaan's extended family.

Senior or Principal Machine Learning Engineer, Computer Vision

Berkshire Grey

Berkshire Grey

Software Engineering
Bedford, MA, USA
Posted on Thursday, May 30, 2024

Minimum Qualifications:

  • Master’s degree in Robotics, Machine Learning, Computer Vision, Computer Science or a closely related field.
  • 4+ years of experience in software development with a focus on robotics manipulation or related areas.
  • Strong development expertise in Python and C++
  • Experience with major deep learning frameworks such as PyTorch
  • Experience with data science tools & libraries like numpy, pandas, scipy, matplotlib, scikit-learn
  • Demonstrated experience training and adapting of existing machine learning architectures for computer vision, such as CNNs/ViTs or VLMs, to solve tasks such as grasp estimation, object detection/segmentation, depth estimation, or anomaly/outlier detection
  • Demonstrated proficiency to solve real world computer vision problems with machine learning
  • Demonstrated ability to:
    • Develop on and troubleshoot real robotic systems
    • Determine and communicate justification of technical priorities
    • Rapidly prototype and iterate on solutions to challenging problems
    • Work independently on a variety of projects while maintaining focus
    • Work in a fast-paced environment with changing priorities
    • Mentor junior engineers
  • Strong verbal and written communication skills, capable of explaining complex ideas clearly and concisely to both technical and non-technical stakeholders
  • Provide technical leadership on key projects

Preferred Qualifications:

  • PhD in Machine Learning, Computer Vision, Computer Science or a closely related field.
  • Demonstrated technical proficiency in computer vision applied to robotic manipulation, such as grasp estimation or long-tailed object detection & segmentation in clutter
  • Experience with:
    • Robotic vision sensors and camera to robot calibration
    • Both RGB and depth data
    • Collecting and training on real and synthetic datasets, including various forms of data augmentation
    • Applying machine learning to hardware interacting with the real world
    • Real-time perception-based control
    • Robot simulators (e.g. Isaac Sim or MuJoCo)
    • Combining model-based and data-driven approaches
    • Docker, cloud computing, or similar applications
    • Experiment tracking and dataset management (e.g. Weights & Biases)
    • Database systems as data source, such as MongoDB
    • Parallel/distributed systems and asynchronous/concurrent programming
    • ROS or ROS2

Possessing some of these preferred qualifications is great to have but not required and should not discourage applicants from applying.

About The Job

Berkshire Grey is a leader in the field of AI and robotics, providing innovative solutions for e-commerce, retail replenishment, and logistics. Our technology automates complex pick, pack, and sort operations.

As part of the Research & Advanced Development group, you will develop new approaches to solving challenging manipulation problems for real-world robotics systems, allowing them to understand and interact with their environment in unprecedented ways. Your work will contribute to enhancing the capabilities of our robotic solutions and explore new solutions and approaches, unlocking new value delivered to our customers. This position offers a unique opportunity to work at the cutting edge of robotics applied to real-world challenges.


  • Develop solution prototypes for vision problems, to improve our robots’ ability to solve increasingly complex tasks at unprecedented speeds
  • Collaborate with external research partners to find solutions for BG’s problem space
  • Quickly prototype solutions, creating demos for stakeholders and visitors
  • Serve as subject matter for transitioning prototypes to product teams
  • Identify high impact areas for improvements of our robotic systems to solve real problems
  • Stay abreast of the latest advancements in robotics and related fields, evaluating applicability to our challenges
  • Assist with mentorship of more junior engineers or interns
  • Communicate technical priorities and status.

6110 -2412TK