About Our Pick and Place Robotic Arm Project

Our project focuses on the development of a highly efficient and versatile robotic arm capable of classifying and picking up various types of waste materials for recycling purposes. The robotic arm uses advanced deep learning techniques in combination with computer vision to identify different materials such as plastics, paper, and metals. The main objective is to enhance recycling efforts and contribute to sustainable waste management by automating the waste classification process.

The project integrates several key aspects, including mechanical design, electrical assembly, deep learning model development, and data wrangling. We have used state-of-the-art hardware components, including an Arduino, NEMA 17 stepper motor, servo motors, and various sensors, to ensure smooth and precise operation. Our deep learning model, trained using Python and Jupyter Notebook, aids in the waste material classification process.

Furthermore, the robotic arm is integrated with a real-time waste tracking system using IoT sensors, providing data on waste levels in bins. This helps ensure timely and efficient waste collection. Our web application, built with Next.js, TypeScript, and Tailwind CSS, displays this data and provides a user-friendly interface for monitoring and controlling the robotic arm.

Hardware and Robotic Arm

Project Purpose

The primary aim of our project is to design and implement a pick-and-place robotic arm capable of efficiently classifying waste materials such as plastics, paper, and metals for recycling. By automating this process, we strive to reduce landfill waste and promote a circular economy through more efficient waste sorting.

Mechanical and Electrical Assembly

Our robotic arm is built using high-quality materials and components to ensure precision and durability. The mechanical assembly includes a combination of 2020 profile extrusions, L-shaped corner brackets, and various screws and nuts to form a sturdy frame. The arm's mechanical movement is powered by a combination of NEMA 17 stepper motors for horizontal and vertical motion, along with MG996R and SG90R servo motors for fine control.

  • 2020 Profile Extrusions and L-shaped Corner Brackets
  • Linear Shaft Rods and Aluminum Rods for Arm Support
  • 20 Teeth 5mm Bore Timing Belt with Idler and Pulley
  • PLA+ Material for 3D Printing the Robotic Arm Parts
  • M2 Screws, Nuts, and M3, M4 Screws with T-Nuts

Deep Learning and Data Wrangling

For waste material classification, we have trained a deep learning model using advanced techniques. We used Python and Jupyter Notebook for model training, leveraging datasets of labeled waste images. The model was trained to accurately classify different materials based on visual features, using object detection algorithms to identify the waste in real time. The data wrangling process involved cleaning and augmenting the data for improved accuracy and generalization of the model.

Training Tools and Annotation

The dataset was annotated using tools like LabelImg, CVAT, and Roboflow, allowing us to label various objects in the images, including plastics, paper, and metal waste. These annotated images were used to train the object detection model, which was fine-tuned using hyperparameter optimization for better accuracy and performance.

Software Specifications

  • Python and Jupyter Notebook for Deep Learning Model Development
  • OpenCV for Image Processing and Computer Vision
  • TensorFlow/PyTorch for Object Detection Model
  • Next.js and TypeScript for Web Application Development
  • Tailwind CSS and Material UI for Frontend Styling
  • Framer Motion for Interactive UI Animations

Hardware Specifications

  • Arduino UNO with CNC Shield for Motor Control
  • NEMA 17 Stepper Motor for Precise Movement
  • MG996R and SG90R Servo Motors for Arm Rotation
  • Aukey 1080p Camera for Real-Time Image Capture
  • IR Sensors for Obstacle Detection and Avoidance

Robotic Arm Design

The design of the robotic arm itself is a combination of 3D-printed PLA+ parts, along with aluminum rods for extra support. The arm is capable of precise movement, which allows it to pick up and place waste materials into the appropriate bins. The use of PLA+ for 3D printing ensures that the arm is both lightweight and strong, making it suitable for handling the typical waste materials in our project.