Robot Vision

Vision - The holy grail of robotics

Vision – The holy grail of robotics


We would like to have robots perform the tasks that we as humans do not want to do. Many of these fall into the heavy, dangerous, repetitive, precise, finicky categories. As humans we learned to accomplish these types of actions as little children, so we do not have a step by step roadmap on how to get this type of task done
The blind leading the blind By UR INC Motoman SDA10 at Smith Springs Lab

The blind leading the blind
By UR INC Motoman SDA10 at Smith Springs Lab


Most of us who have implemented robots find that blind repetition of actions, however well conceived leads to less than desired results. Real processes are not perfectly consistent and real parts have tolerances. As engineers we normally try to compensate for the fliers that we have experienced, but new types of defects emerge in the global race to the bottom. For example it was only recently that I had to fight with bolts where the hex head was partially formed. This totally jams the automatic feeding and installation equipment. Dumb and happy. The robotic automation cannot cull out the defective parts which is a simple task for the humans that they replaced. Fortunately in this case, I included a proximity switch in my arm end that could be used for sorting.
Capacitive proximity switches detect objects before they are hit

Capacitive proximity switches detect objects before they are hit


It is possible to use a proximity switch to measure to an accuracy down to .001 inch. (high accuracy measurements have a significant time penalty due to multiple probe motions) I recommend including extra vision catagory features when implementing new robot installations. In this fast changing business environment it is highly likely that your robots will need to be taught new tricks before they are taken out of service. Small investments in sensors like $100 proximity switches can be very useful in shortening the reaction time to unforeseen process challenges. The Fraunhoffer institute is pioneering in the implementation of capacitive “vision” In the linked article by Dr. techn. Norbert Elkmann the usefulness of advanced sensing is explored. “Manufacturing has great need of robots with high load carrying capacity for human-robot collaboration. Since the potential risk for humans in the event of a collision is naturally greater than when robots are smaller, the use of robots with high load carrying capacity in the direct vicinity of humans requires smart sensor systems such as capacitive sensors that detect proximity.” http://www.iff.fraunhofer.de/en/business-units/robotic-systems/capacitive-sensors.html
As we continue to use robots to replace humans, It will be necessary to create robots that incorporate human sensory capability. Touch will be one of the first areas that changes. Since material handling is one of the primary robot uses, controlling the applied force is a requirement. We have all been frustrated with the robot gripper in the arcade game. It drops the prize at every opportunity. If we wish to use a robot to replace humans the gripper needs tactile sensors. This mimics human touch using a strategy similar the human it replaces. Nerve endings, concentrated in our finger tips, transmit a whole bunch of data down the arm
Grippers have evolved from the arcade version to the state of the art Tactilus Multi-vector Sensor - Sensor Products Inc

Grippers have evolved from the arcade version to the state of the art Tactilus Multi-vector Sensor – Sensor Products Inc

Just force sensors by themselves may not be enough. It may also be necessary to have individual finger motion control. Other tasks arer even more sophisticated. Simply having force sensors may not be enough to prevent impact damage. The Lexus like most modern passenger cars has a ring of impact sensors around the body. Even though rush hour feels like bumper cars some days, it is not very effective to wait until the sensor detects contact as a strategy for safe following in traffic.
by METRO66 Wheeler Dealer Bumper Cars by Mariordo Driving Google Self-driving Car

by METRO66 Wheeler Dealer Bumper Cars
by Mariordo Driving Google Self-driving Car

As we look into the future of robotics, we will see a massive increase in the amount of data that is processed to accomplish the robot tasks. The current individual wires down the arm will be replaced by arm end processors and fiber optic links. Full vision control will occur in high volume premier applications, but cost limitations will result in selected use for other industrial tasks.

KISS

KISS also applies to automation

KISS also applies to automation


KISS — Keep It Simple Stupid
Early in my career I was assigned the task of commissioning an $70,000 electric paint robot. Unfortunately at that stage of robot evolution, the seal design at the robot joints prevented it from painting more than the first part. The vapors shorted it out. What I learned is that it is more effective to tackle automating the simplest tasks first. Simple tasks take less investment to automate. Even though modern 6 axis robots can now handle painting tasks, combining them with required sophisticated guard enclosures places them far from the KISS category in my mind.
I was watching a 2 axis gantry “robot” carry engine cylinder heads at a Honda assembly plant in Alabama. Reminded me of a dog playing fetch with a stick. The jaws of the gripper opened and the human at the end was presented with the retrieved cylinder head. I install gantry robot transport systems for the same benefit, their simple motion and guards allow humans to safely work along side them. These robots do not care that I am comparing them to a dog. As Ada Lovelace wrote as her work began the digital age “The Analytical Engine has no pretensions whatever to originate anything. It can do whatever we know how to order it to perform”
A Spaniel fetches a stick by Kleuske

A Spaniel fetches a stick by Kleuske

Kiva robots are even simpler. They race to the other end of the warehouse and wait like puppy dogs for us to collect the item they have retrieved. All of this without the clutter of the rails and guards of gantry retrieval systems.
Moore’s law marches on. The cost of computers has dropped to the point where we can afford to automate even simple tasks. It is easy to write down date, starting odometer, location, finishing odometer and purpose for one business trip. You get pissed off enough to invent a better way when you spend a chunk of every Christmas vacation inputting a list of a thousand or so business trips so that you qualify to keep the $8000 to $9000 dollar business mileage deduction. I want to use the KISS principle to fix all the aggravations in my life.
Capture your full mileage deduction

Capture your full mileage deduction

It is nice that an affordable computer http://mileagetrakker.com can talk to the car and generate the log for me

Lean Automation

Mileage Trakker verses Fanuc ARC Mate 120iC/10L taken by Phasmatisnox

Mileage Trakker verses
Fanuc ARC Mate 120iC/10L taken by Phasmatisnox

I have to admit that many years of installing robots to reduce labor has blinded me into thinking of automation as robots to be installed. This matched the marketplace because the $200,000 robots morphed into $50,000 robots opening the door for new applications with each price drop. Shop floor manufacturing cost which was $.50 of every sales dollar in the 1950’s has steadily declined to $.20 of every sales dollar today. Since 80% of the current business costs are not on the manufacturing floor, it is not surprising that the best opportunities for reducing cost by automating are no longer on the shop floor.
It would be naive to claim that no automating activity has occurred off the shop floor. The PC, then smart phone revolutions, have brought the efficiency of software to our fingertips. We would not even consider typing and mailing a letter anymore. PC Office suite software is now available as “free” open source downloads. The more recent smartphone market is equally mature. Even as early as 2010, 90% of the smart phone apps sold less than 100,000 copies, which suggests that they failed to cover their development costs.
The 80% share of business cost off the shop floor shows that the current opportunities are still away from the shop floor. The developers agree and the latest excitement is centered around innovations that combine software and hardware. This is consistent with what I am seeing. Somewhere in the future your cars will have enough connectivity and spare computers or your cell phone will have enough battery capacity to handle extra tasks. In the short term dedicated devices such as the mileage trakker http://mileagetrakker.com that I market are good examples of the latest trend. Business people who travel are happy that a device plugged into the car handles most of the assembly of an IRS format mileage report so that they can receive their significant mileage deduction at income tax time