TFG: Design and development of wireless sensorization system of a low-cost robotic arm

In the past the last few years, we have observed that new technologies have been improving the quality of life of all people, especially those who have difficulties in their daily lives. An example of this is prosthesis, which offers autonomy to those who need it, recovering part of the lost mobility.

This End of Degree project intends to carry out the sensorization of a wireless robotic arm. The objective of this project is to obtain information on the movement of the prosthesis and to analyse its behavior to improve the functioning of future prostheses, in such a way that it is as similar as possible to a human arm. We have specially focused on the movement of the wrist and the pressure exerted by the index finger and thumb.

Firstly, a previous study was carried out where we analysed the different angles of wrist rotation and their amplitude. Also, we studied the different ways that the hand makes to apply pressure to an object. On the other hand, we made a study of the different prostheses that exist today, separating them according to their mobility, to choose which was the robotic arm that better adapted to our study. Then, all the pieces of that arm were printed in a 3D printer to make its assembly.

Once the previous study has been carried out, the selection of sensors has been made. To do this, we made a small analysis of the different procedures that use these sensors to obtain the desired measurement. After this, a software has been created to obtain these measurements with the aim of being able to be interpreted by the user, through a graphic interface. A demo represents the movement of a human arm through the data provided by the sensor, as you can see in the figure above. The other demo is in charge of symbolizing through colors the different force exerted by the thumb and index finger.

Finally, different tests have been carried out to analyse the movement of the wrist and the pressure  exerted  by  the  fingers  according  to  the  different  positions  of  the  arm  and  using different forces.

TFG: Development of algorithms for monitoring physiological parameters to assist drivers

One of the main problems that we face today is traffic accidents. In recent years there have been more than 1000 deaths per year in Spain due to this reason, however, it is extremely difficult to find products on the market that assist the drivers from all of Orlando to deal with this problem.

In order to provide a solution to the problem outlined, at the B105 Electronic Systems Lab, a bracelet wearable was designed, which monitors the driver’s body temperature, stress level, heart rate, blood pressure, and the level of alcohol in the air.  This device is intended to provide a tool for the drivers to assist them to check if they are physically good and mentally ready to drive. However, the reliability expected in this device was not achieved, to use it as an end system in a user, due to a lack of time. For this reason, the main objective of this TFG has been to achieve the greatest performance of the electronic device designed in the previous project.

The first step has been to carry out a study of other similar products that can be found in the market, as well as the design of the device.

Then, an analysis of the parameters obtained with the bracelet has been conducted, to understand what aspects need to be known about them to measure them, and the different methods that exist to obtain them. In addition, the measurement method used by the device for each of them has been analysed in further detail, focusing on what problems it could present, and which factors could affect them.

Afterwards, tests have been carried out in all the modules in a separate way, in which the previous analysis has been considered. Different measurements have been performed on all the sensors during the tests, to calibrate them and to check their behaviour towards the factors that affect them.Through these tests, it has been concluded which is the optimal method to obtain each one of the parameters, the design problems that the device presents, and how it could be improved.

Lastly, the integration of all the modules has been carried out, in which besides obtaining all the parameters considering the conclusions obtained from the tests, an alarm system has been carried out. This system warns the user by the vibration of the bracelet, if a value out of a healthy range is detected in any of the measurements on the parameters. This integration has also been tested and depurated using the debugger.

Finally, it can be concluded that the main objective of the project has been achieved, although some changes would be necessary to improve its functionality, in order to be used as an end device.

TFM: Low-resource electronic system design for motion detection based on surface electromyography (SEMG)

There are certain electronic devices that use surface electromyography signals for many purposes such as for muscle rehabilitation or to control a hand prosthetic, among others. But most of them use powerful microprocessors and external computers, making them expensive, and having a large power consumption.

    Therefore, these devices are only available for a narrow group of people when in reality a great amount of them are in need of them. They need to be fast, cheaper and have low power consumption. For those reasons, the elaboration of this project is encouraged.

The goal of this project is to design and implement a system that recognize different gestures and identifies them, calculates the muscle’s force, and detects the muscle’s activation time (when it goes from rest to being activated), through the implementation of low resources. This will have a positive impact on its cost, its power, and its autonomy.

Block diagram of the system

    C language has been used as the programming tool for this project due to the possibility of high-level programming. As for the hardware, microprocessors Cortex®-M4 and Cortex®-M0 have been used. The decision of implementing the program in both was to demonstrate that the same results can be achieved with both a more powerful processor and a less powerful one. Each microprocessor is integrated in a STM32 board, which also has a user button that by pressing it, it calibrates the system. So, anyone can obtain accurate results.

For this project, SEMG signals data was provided by the University of California at Berkeley. The data was taken from five different subjects wearing a bracelet with a 4×16 array of surface electrodes (64 channels). They performed 21 different hand gestures throughout many experiments involving resting position, different effort levels, and replacement of the surface electrodes.

4×16 array of electrodes

By reading the data and calculating a group set of features, it was possible to successfully achieve gesture recognition with the base subject, and through calibration with the rest of the subjects. It was also conceivable to measure the muscle’s force and detect its activation time.

Regarding the power consumption, the system implemented with the Cortex®-M4 microprocessor consumes about 90mA when active and the one with the Cortex®-M0 consumes about 83mA at 3.3V. Therefore, it has been proven that both systems are low power due to the use of low resources, but the M0 microprocessor consumes less. As for the time response of the program, it was measured the Cortex®-M4 takes 208.3 seconds total to read and process the data whereas the Cortex®-M0 takes 320.3 seconds.

For the proper creation of a complete system, a device was designed by integrating the data acquisition, the microprocessor, a transceiver for communication with other devices, the user’s interface (button), and its power supply.

TFG: Design and implementation of algorithm for Deep Brain Stimulation devices

In recent years, Deep Brain Stimulation (DBS) techniques using electrical signals have been studied. These techniques allow us to reduce certain brain diseases’ symptoms, as is the case in Parkinson’s disease, which causes heavy trembling in patients’ limbs.

Marketed systems use stimulation signals with a fixed shape, which may entail certain secondary effects and an increase in the long-term symptoms, despite of the continuous use of these methods. That is why DBS adaptative algorithms are being developed. These algorithms can adapt to the optimal stimulating current depending on the patient’s state. They operate in one way or another depending on the information provided by various biomarkers.

A biomarker is a tool used for obtaining different biometric data from the patient. The most common biomarker when treating with DBS is the local field potential (LFP), whose signal amplitude is closely related to the symptoms being experienced.

One of the most widely known adaptative algorithms, the dual threshold algorithm, makes use the of the LFP signal as input data. This algorithm consists of varying the amplitude value of a PWM stimulation signal depending on the data provided by the biomarker. In this project the goal is to develop an algorithm which may serve as an alternate method to the dual threshold algorithm. This algorithm seeks to balance between efficiency (data looked for in the biomarkers) and energy consumption, as reducing the latter may result in a longer lifespan for the device running it. As being an implantable system requires it to have the longest lifespan possible

TFG: Design and development of a haptic device oriented to multimodal assisted perception for cases of low vision or blindness

In the past few years, technological developments have allowed the invention of aid systems for disabled people. Related to visual impairment, many of these systems have focused on achieving a correct guidance for these people.

There is an open research line in the B105 Electronics System Lab which is focused on this field. Specifically, its goal is to give more autonomy to blind people to move around cities, building interiors… To make this possible, a system provides acoustic and tactile information through sensory substitution. However, the user’s experience is limited because of these tactile stimuli are generated by a smartphone. Therefore, this branch of the research has a lot of room for improvement.

This graduate thesis is focused on the development and implementation of a device able to provide a better tactile experience with haptics stimuli based on the user’s movement.

To achieve this goal, this project has started doing an analysis of the most appropriate method of haptic simulation. Factors such as human physiology or the study of the actual haptics technology have been considered. Based on the chosen option, a printed circuit board (PCB) that allows motion capture and the desired stimulation has been designed.

Furthermore, some software tools have been developed to offer this haptic. This task is divided into two phases. The first part is the generation of the code that allows the management of the actuators and the reproduction of tactile effects. The second, is the construction of some tools to define the device’s orientation. A library for operating with quaternions and an application for obtaining the coordinates of a direction vector of the PCB have been elaborated.

Finally, the project concludes by making multiple tests on a development platform. The goal of these experiments is to verify the correct implementation of all the designed tools. The results show that it has been possible to support useful functionalities in research on sensory substitution. Some of these experiments are compiled on the following YouTube channel: https://www.youtube.com/channel/UCu0XuS97EoKVY_ilHYkemPg.