Creating Interactive Social Robots and Multimodal Control of Robotic Hands with Artificial Muscles

Simple item page
dc.contributor.advisorTadesse, Yonas
dc.contributor.advisorGans, Nicholas
dc.creatorJafarzadeh, Mohsen
dc.creator.orcid0000-0001-7719-7081
dc.date.accessioned2021-12-15T20:41:50Z
dc.date.available2021-12-15T20:41:50Z
dc.date.created2019-12
dc.date.issued2019-11-22
dc.date.submittedDecember 2019
dc.date.updated2021-12-15T20:41:51Z
dc.description.abstractSocial robots are essential for healthcare applications as assistive devices or behavior-based intervention systems. Social interactions, robotic hands and multimodal control are three core aspects of social robots, which are investigated in this dissertation. First, we present a wearable sensor vest and an open-source software architecture with the Internet of Things (IoT) for social robots. The IoT feature allows the robot to interact with local humans and other humans over the Internet. The designed architecture is demonstrated in a humanoid robot, and it works for any social robot that has general-purpose graphics processing unit (GPGPU), I2C/SPI buses, Internet connection, and Robot Operating System. The modular design of this architecture enables developers to easily add/remove/update complex behaviors. The proposed software architecture provides IoT technology, GPGPU nodes, I2C and SPI bus mangers, audio-visual interaction nodes, and isolation between behavior nodes and other nodes. Second, our humanoid robot uses novel actuators, called twisted and coiled polymer (TCP) actuators/artificial muscles, to move its fingers. Classical controllers and fuzzy-based controllers are examined for force control of these actuators. It was noted that disturbance and noise are major challenges in system identification and control of TCPs. In a short term, the muscles behave like a first-order, linear time-invariant system when the input is voltage square and the output is either force or displacement. However, the behaviors and parameters of the polymer muscles slowly change. An on-policy adaptive controller is designed for regulating force of the muscles that is optimized by stochastic hill-climbing and a novel associated search element. The third part is multimodal control of robotic hands. Recent advancements in GPGPUs enable intelligent devices to run deep neural networks in real-time. Thus, state-of-the-art intelligent systems have rapidly shifted from the paradigm of composite subsystems optimization to the paradigm of end-to-end optimization. By taking advantages of GPGPU, we showed how to control robotic hands with raw electromyography signals and speech 2D features using deep learning and convolutional neural networks. The proposed convolutional neural networks are lightweight, such that it runs in real-time and locally in an embedded GPGPU.
dc.format.mimetypeapplication/pdf
dc.identifier.urihttps://hdl.handle.net/10735.1/9352
dc.language.isoen
dc.subjectInternet of things
dc.subjectAndroids
dc.subjectMachine learning
dc.subjectGraphics processing units
dc.subjectAdaptive control systems
dc.subjectArtificial intelligence
dc.titleCreating Interactive Social Robots and Multimodal Control of Robotic Hands with Artificial Muscles
dc.typeThesis
dc.type.materialtext
thesis.degree.departmentElectrical Engineering
thesis.degree.grantorThe University of Texas at Dallas
thesis.degree.levelDoctoral
thesis.degree.namePHD

Files

Original bundle

Now showing 1 - 1 of 1
Thumbnail Image
Name:
JAFARZADEH-DISSERTATION-2019.pdf
Size:
10.33 MB
Format:
Adobe Portable Document Format
Download

License bundle

Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.85 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
1.84 KB
Format:
Plain Text
Description:
Download

Collections

UTD Theses and Dissertations