Please enable JavaScript to view the comments powered by Disqus. A few easy lessons to show robots how to drive a car





A few easy lessons to show robots how to drive a car



Last updated 23/07/2021

A few easy lessons to show robots how to drive a car

Envision if robots could gain from watching showings: you could tell a homegrown robot the best way to do routine tasks or set a supper table. In the working environment, you could prepare robots like new representatives, telling them the best way to perform numerous obligations. Out and about, your self-driving vehicle could figure out how to drive securely by watching you cruise all over your area. 

Gaining ground on that vision, USC researchers have planned a framework that lets robots self-sufficiently take in muddled undertakings from few showings - even flawed ones. The paper, named Learning from Demonstrations Using Signal Temporal Logic, was introduced at the Conference on Robot Learning (CoRL), Nov. 18.

The analysts' framework works by assessing the nature of every exhibition, so it gains from the mix-ups it sees, just as the victories. While present state-of-art strategies need at any rate 100 shows to nail a particular assignment, this new strategy permits robots to gain from just a modest bunch of exhibitions. It additionally permits robots to learn all the more instinctively, the manner in which people gain from one another - you watch somebody execute an assignment, even incompletely, at that point attempt yourself. It doesn't need to be a "great" showing for people to gather information from observing one another.

"Many machine learning and reinforcement learning systems require large amounts of data and hundreds of demonstrations -- you need a human to demonstrate over and over again, which is not feasible," said lead author Aniruddh Puranic, a Ph.D. student in computer science at the USC Viterbi School of Engineering.

"Also, most people don't have the programming knowledge to explicitly state what the robot needs to do, and a human cannot possibly demonstrate everything that a robot needs to know. What if the robot encounters something it hasn't seen before? This is a key challenge."

Learning from demonstrations

Learning from demonstrations is getting progressively mainstream in acquiring successful robot control approaches - which control the robot's developments - for complex undertakings. In any case, it is defenseless to blemishes in exhibits and furthermore raises wellbeing worries as robots may learn dangerous or bothersome activities. 

Additionally, not all exhibitions are equivalent: a few shows are a superior pointer of wanted conduct than others and the nature of the showings regularly relies upon the ability of the client giving the showings. 

To address these issues, the analysts incorporated "signal temporal logic" or STL to assess the nature of showings and consequently rank them to make intrinsic prizes. 

All in all, regardless of whether a few pieces of the showings don't bode well dependent on the rationale necessities, utilizing this technique, the robot can in any case gain from the blemished parts. As it were, the framework is arriving at its own decision about the exactness or achievement of a show.

"Let's say robots learn from different types of demonstrations -- it could be a hands-on demonstration, videos, or simulations -- if I do something that is very unsafe, standard approaches will do one of two things: either, they will completely disregard it, or even worse, the robot will learn the wrong thing," said co-author Stefanos Nikolaidis, a USC Viterbi assistant professor of computer science.

"In contrast, in a very intelligent way, this work uses some common sense reasoning in the form of logic to understand which parts of the demonstration are good and which parts are not. In essence, this is exactly what also humans do."

Take, for instance, a driving exhibition where somebody avoids a stop sign. This would be positioned lower by the framework than a show of a decent driver. Yet, in the event that during this showing, the driver accomplishes something wise - for example, applies their brakes to dodge an accident - the robot will at a present gain from this savvy activity.

Adapting to human preferences

Signal temporal logic is an expressive numerical representative language that empowers automated thinking about current and future results. While past research around there has utilized "linear temporal logic," STL is best for this situation, said Jyo Deshmukh, a previous Toyota architect and USC Viterbi aide educator of software engineering.

"When we go into the world of cyber-physical systems, like robots and self-driving cars, where time is crucial, linear temporal logic becomes a bit cumbersome, because it reasons about sequences of true/false values for variables, while STL allows reasoning about physical signals."

Puranic, who is exhorted by Deshmukh, concocted the thought in the wake of taking an involved mechanical technology class with Nikolaidis, who has been chipping away at creating robots to gain from YouTube videos. The triplet chose to test it out. Each of the three said they were astounded by the degree of the framework's prosperity and the teachers both credit Puranic for his persistent effort.

"Compared to a state-of-the-art algorithm, being used extensively in many robotics applications, you see an order of magnitude difference in how many demonstrations are required," said Nikolaidis.

The framework was tried utilizing a Minecraft-style game test system, yet the analysts said the framework could likewise gain from driving test systems and at last even recordings. Next, the scientists would like to give it a shot on genuine robots. They said this methodology is appropriate for applications where guides are known previously however there are dynamic obstructions in the guide: robots in family unit conditions, distribution centers, or even space exploration rovers.

"If we want robots to be good teammates and help people, first they need to learn and adapt to human preference very efficiently," said Nikolaidis. "Our method provides that."

"I'm excited to integrate this approach into robotic systems to help them efficiently learn from demonstrations, but also effectively help human teammates in a collaborative task."

Topic Related Post

ITSM Vacancies in 2021
The First Quantum Computing Applications Lab in India is being Built
AWS Sees a 54% Revenue Jump In India (Post Pandemic)

About Author

NovelVista Learning Solutions is a professionally managed training organization with specialization in certification courses. The core management team consists of highly qualified professionals with vast industry experience. NovelVista is an Accredited Training Organization (ATO) to conduct all levels of ITIL Courses. We also conduct training on DevOps, AWS Solution Architect associate, Prince2, MSP, CSM, Cloud Computing, Apache Hadoop, Six Sigma, ISO 20000/27000 & Agile Methodologies.



* Your personal details are for internal use only and will remain confidential.


Upcoming Events


Every Weekend


Every Weekend


Every Weekend


Every Weekend

Topic Related

Take Simple Quiz and Get Discount Upto 50%

Popular Certifications

AWS Solution Architect Associates
SIAM Professional Training & Certification
ITIL® 4 Foundation Certification
DevOps Foundation By DOI
Certified DevOps Developer
PRINCE2® Foundation & Practitioner
ITIL® 4 Managing Professional Course
Certified DevOps Engineer
DevOps Practitioner + Agile Scrum Master
ISO Lead Auditor Combo Certification
Microsoft Azure Administrator AZ-104
Digital Transformation Officer
Certified Full Stack Data Scientist
Microsoft Azure DevOps Engineer
OCM Foundation
SRE Practitioner
Professional Scrum Product Owner II (PSPO II) Certification
Certified Associate in Project Management (CAPM)
Practitioner Certified In Business Analysis
Certified Blockchain Professional Program
Certified Cyber Security Foundation
Post Graduate Program in Project Management
Certified Data Science Professional
Certified PMO Professional
AWS Certified Cloud Practitioner (CLF-C01)
Certified Scrum Product Owners
Professional Scrum Product Owner-II
Professional Scrum Product Owner (PSPO) Training-I
GSDC Agile Scrum Master
ITIL® 4 Certification Scheme
Agile Project Management
FinOps Certified Practitioner certification
ITSM Foundation: ISO/IEC 20000:2011
Certified Design Thinking Professional
Certified Data Science Professional Certification
Generative AI Certification
Generative AI in Software Development
Generative AI in Business
Generative AI in Cybersecurity
Generative AI for HR and L&D
Generative AI in Finance and Banking
Generative AI in Marketing
Generative AI in Retail
Generative AI in Risk & Compliance
ISO 27001 Certification & Training in the Philippines
Generative AI in Project Management
Prompt Engineering Certification
SRE Certification Course
Devsecops Practitioner Certification
AIOPS Foundation Certification
ISO 9001:2015 Lead Auditor Training and Certification
ITIL4 Specialist Monitor Support and Fulfil Certification
SRE Foundation and Practitioner Combo
Generative AI webinar
Leadership Excellence Webinar
Certificate Of Global Leadership Excellence
SRE Webinar
ISO 27701 Lead Auditor Certification
Gen AI for Project Management Webinar
Certified Cloud Tester Foundation
HR Business Partner Certification
Chief Learning Officer Certification