Modeling, Optimization, and Control Methods for a Personalized Hybrid Walking Exoskeleton

The central objective of this study is to validate new algorithms that coordinate between functional electrical stimulation (FES) and the exoskeleton during sitting-to-standing, walking, and standing-to-sitting movements. The secondary objective is to optimize the algorithms as well as assess their ability to reduce FES-induced muscle fatigue by using ultrasound imaging as a sensing modality. This study will include persons with no disabilities and persons with Spinal Cord Injury (SCI). A research set-up comprising of a lower-limb exoskeleton and FES system will be used to achieve sitting-to-standing, walking, and standing-to-sitting movements. Ultrasound Imaging probes may be used to record muscle activity of the stimulated muscles. The signals derived from ultrasound will be used to optimize FES in order to reduce muscle fatigue as well as assess muscle fatigue.

Research activities involve use of computer-controlled functional electrical stimulation (FES) and electric motor-driven orthosis (powered exoskeleton) to generate functional lower-limb movements for; i.e., standing and walking. The computer-controlled algorithms will get feedback from sensors such as optical encoders, load cells, force sensitive resistors, and inertial measurement units that are or will be inbuilt in the orthosis or these feedback algorithms will be combined with precomputed optimized algorithms based on the estimated musculoskeletal model of a participant. Multiple computer algorithms will be designed to coordinate FES with electric motors and other components of the walking device to reproduce or restore standing and walking movements. The study involves validation of computer algorithms to estimate and control the walking and sitting/standing movements. The Rifton E-Pacer motorized walker, arm crutches, parallel bars, or a conventional walker may be used in order to assist donning and doffing of the exoskeleton system, standing, and walking for all subjects, at any time during experimentation, for as long as is deemed necessary by the experimental goals. Using the E-Pacer or a walker should improve experiment safety and reduce the subject's overall physical exertion because it reduces load on the subject's body. Sitting/Standing and/or walking movements will be elicited by the hybrid walking platform that combines a powered exoskeleton and an FES system. The powered exoskeleton can provide joint actuation at the hip and knee joints of a participant. The FES system can stimulate the quadriceps, hamstrings muscle, glutes, and ankle muscles. The electrodes for stimulation are placed on the skin at locations that provide an optimal limb movement. The algorithms are designed such that the stimulation of different muscles are coordinated to achieve walking and/or sitting/standing. A precedent experiment will be performed on a Group B participant before it is tested on Group A. Unlike the paraplegic participants (Group A), if the device should fail or act unexpectedly the persons without disability (Group B) will be able to intervene . Therefore, testing the device on persons without disability first will allow us to further assess and address any risks before testing on individuals with SCI, who are incapable of intervening with the device. All the sessions for Group A participants will be performed in the supervision of a physical therapist. The therapist will also assist the Group A participants in transferring them from their wheelchairs to a cushioned table for seating if required or to the exoskeleton. Group A participant will also be supported by a body-unweighing system to prevent falling during standing and walking. Before each experiment involving electrical stimulation, a participant's heart rate and blood pressure will be recorded. Therapists will also assist the participants in transferring them from their wheelchairs to the therapy table. A participant or an individual operating the device will initiate walking and/or standing movement. A participant can stop the movements if he/she feels not comfortable or unsafe by using a safety-stop button, which will be given to them. During these sessions participants will wear a heart rate monitor to ensure that they do not overexert themselves, and so that sufficient rest periods may be given. The participants' heart rate will be checked before and after each trial by an individual conducting the experiments. The Borg scale will be administered for Group A to check for their exertion level. The sessions will be stopped as per the limits prescribed by the Borg scale (see stopping criteria in risks section). Please note that for all experiments described, a minimum of 1-2 days is required between visits for experimentation. These activities are divided into Aim 1 and Aim 2. Please note that Aims 1-2 are not sequential. Aim 1: To elicit sitting/standing and walking movements by using an optimized powered exoskeleton and functional electrical stimulation (FES) assistance. The objective of this aim is to experimentally validate an optimal controller that allocates FES and exoskeleton contribution based on a person-specific model of a participant. The controller will produce lower-limb movements in persons with no disabilities and persons with spinal cord injury. Group A and Group B will participate in approximately 20 sessions. The number of sessions is approximate and it may exceed this number and there is not cut-off number of sessions that will prohibit further participation. The session duration will be up to 4 hours, at the maximum. The session durations are approximate and it can be more or less than the specified. The total number sessions may overshoot by few sessions for some participants due to unanticipated technical or erroneous experimental data. These experiments will be conducted in the Neuromuscular Control and Robotics Laboratory (NCRL) or at the Outpatient Rehabilitation Clinic at Chapel-Hill run by the principal investigator. These experiments are divided into 2 tasks. Task 1: Initial visits for familiarization, training and model identification. Familiarization and training visits will allow us to customize and optimize the hybrid walking exoskeleton to each participating individual. For this task the participants will visit the NCRL for approximately 3 sessions. These sessions will take no more than 4 hours. The session durations are approximate and it can be more or less than the specified. The total number sessions may overshoot by few sessions for some participants due to unanticipated technical or erroneous experimental data. In the first visit, adjustments to the hybrid device will be made to fit the device to the participant. In these visits, the objectives are to train them for sit-to-stand transfers and perform walking movements with the hybrid walking device. Computer controlled algorithms will be used for performing sit-to-stand, stand-to-sit, and walking movements. Model identification experiments to find model parameters for each individual can be run during initial training and familiarization studies. These model identification experiments can be conducted while a participant sits/stands or walk in the hybrid walking device. Once the subject-specific parameters are identified, a walking and/or standing algorithm that coordinates FES with the powered exoskeleton will be derived or optimized using offline dynamic optimizations. Task 2: Validation of a sitting/standing and/or walking algorithm. After initial visits (Task 1), walking and/or standing algorithm will be tested. The algorithm is a computer program that takes sensory information from different sensors such optical encoders, inertial measurement units, and heel contact sensors in-built in the hybrid walking system to optimally coordinate FES and electric motors of the powered exoskeleton. The algorithm will be experimentally validated on each participant in approximately 7 sessions. Each session will run for no more than 4 hours, which includes time to perform standing, walking, periods of rest, time required to adjust bracing, and time required to update the computer code if needed. Note that the number of sessions and duration are estimates and are subject to change based on conditions of the experiment. A motion capture system may also be used to measure joint angles so that spatiotemporal gait characteristics can be compared with the normal gait of a healthy control subject. The recorded gait data will also be used to assess the performance of the control systems of the device, and to show how the user's gait changes over time as they become more comfortable with using the device. These sessions may be recorded so that the application and efficacy of the device may be illustrated. Aim 2: Integrating ultrasound-based feedback to control a hybrid exoskeleton. The objectives of this aim are to investigate if ultrasound imaging can be used as a tool to measure muscle fatigue induced by FES and further use the US-derived signals to optimize FES and exoskeleton assistance. The first objective of this aim is to develop an ultrasound based fatigue model to indicate the onset of muscle fatigue. The second objective is to use the ultrasound-based fatigue model in an algorithm that coordinates control of FES and electric motor during sitting-to-standing, walking, and standing-to-sitting activities. Group A and Group B individuals will participate in this aim. They will participate in approximately 10 sessions of no more than 4 hours each. The total number sessions can be more or less than 10 due to unanticipated technical or erroneous experimental data or if the participant leaves the study. These experiments will be conducted in NCRL or at the Outpatient Rehabilitation Clinic at Chapel-Hill. Task 1: Development of an ultrasound imaging based fatigue and recovery measures of leg muscles. A stimulation protocol will be followed that produces muscle fatigue. Muscle fatigue is defined as some percentage decline in isometric torque generated by FES of the quadriceps muscle. Because decline in the isometric torque could differ in different participants a common stimulation protocol will be employed for all the participants. This will be done during approximately two sessions that will each last no more than 4 hours. The session durations are approximate and it can be more or less than the specified. The total number sessions may overshoot by few sessions for some participants due to unanticipated technical or erroneous experimental data. Both ultrasound (using the imaging probe placed in between the electrodes) and torque data (from the load sensor) will be collected. A hand-held commercial ultrasound transducer (5- 20 MHz clinical transducer) connected to a commercial ultrasound system (S-Sharp Corporation, Taiwan) placed against the skin. A warm gel is applied to the skin to help with imaging. All the ultrasound imaging parameters including intensity and frame rates etc. are below safety guidelines for clinical ultrasound imaging (MI values less than 1.9). After these experiments, the processed ultrasound data will be correlated with the measured torque to determine fatigue and recovery measures. Task 2: Incorporation of the ultrasound-based fatigue model in a control allocation algorithm. The ultrasound imaging-based fatigue and recovery measures can be used to predict the onset of muscle fatigue. The experimental studies will be conducted on (Group A) and (Group B) over 2 sessions will each last no more than 4 hours. The session durations are approximate and it can be more or less than the specified. The total number sessions may overshoot by few sessions for some participants due to unanticipated technical or erroneous experimental data. The algorithms in Task 2 of Aim 1 will be modified to incorporate the ultrasound-based fatigue and recovery measures. Remark on stimulation parameters to be used in the aforementioned aims: A normal range of stimulation to be used in our studies is: pulse width 100-400 micro seconds; Frequency: 20-100 Hz; Current 0-100 mA. Generally during the experiment, the current is automatically modulated (or in some instances manually) starting from 0 mA to the value that is required to achieve a task. This is achieved by feedback signals to the control system that communicates with the stimulator. The control system does not allow the current to go above its maximum limit. The pulsewidth and frequency are generally kept constant. The stimulation parameters used for each participant will be documented for each experimental session and any changes in the stimulation parameters during a session will also be recorded.

Rehabilitative Robotics, Exoskeleton, Hybrid Neuroprosthesis, Spinal Cord Injury, Functional Electrical Stimulation, Ultrasound, Muscular Fatigue

The central objective of this study is to validate new algorithms that coordinate between functional electrical stimulation (FES) and the exoskeleton during sitting-to-standing, walking, and standing-to-sitting movements. The secondary objective is to optimize the algorithms as well as assess their ability to reduce FES-induced muscle fatigue by using ultrasound imaging as a sensing modality. This study is performed with two sets of subjects: people with spinal cord injury and people without disability.

Ten individuals with SCI at the T1-T10 level will be recruited (Group A). These individuals can have incomplete or complete paraplegia.

Twenty individuals without disability will be recruited (Group B). Individuals with SCI who have experience in using some kind of walking assistive devices in the recent past will be preferably recruited.

The study involves validation of computer algorithms to estimate and control walking movements. The Rifton E-Pacer motorized walker, arm crutches, parallel bars, or a conventional walker may be used in order to assist donning and doffing of the exoskeleton system, standing, and walking for all subjects, at any time during experimentation. Walking movements will be elicited by the hybrid walking platform that combines a powered exoskeleton and an FES system. The powered exoskeleton can provide joint actuation at the hip and knee joints of a participant. The FES system can stimulate the quadriceps, hamstrings muscle, glutes, and ankle muscles.

The study involves validation of computer algorithms to estimate and control sitting/standing movements. The Rifton E-Pacer motorized walker, arm crutches, parallel bars, or a conventional walker may be used in order to assist donning and doffing of the exoskeleton system, standing, and walking for all subjects, at any time during experimentation. Sitting/Standing movements will be elicited by the hybrid walking platform that combines a powered exoskeleton and an FES system. The powered exoskeleton can provide joint actuation at the hip and knee joints of a participant. The FES system can stimulate the quadriceps, hamstrings muscle, glutes, and ankle muscles.

The computer-controlled algorithms will get feedback from sensors that are inbuilt in the neuroprosthesis (exoskeleton). A motion capture system may also be used to measure joint angles so that spatiotemporal gait characteristics can be compared with the normal gait of a healthy control subject. Ultrasound imaging can be used as a tool to measure muscle fatigue induced by FES. The performance of the controls algorithm and success of the movements generated will be evaluated after this data is collected.

The muscle fatigue index will be measured to assess muscle fatigue in a participant using the hybrid neuroprosthesis/exoskeleton.

We may ask the participant about their qualitative experience about the of our device and algorithms during the experiments.

Inclusion criteria for persons with SCI: Participants will be men and women age 18-60 and have a primary diagnosis of complete or incomplete spinal cord injury, weigh less than 220 pounds (100kg), free from acute illness, and be at least 1 year post injury. Individuals with injury between T-1 and T-10 level will be recruited (injury level for each participant will be assessed by a therapist on ASIA scale). Medically stable with medical clearance for participation, no evidence of cardiopulmonary or pulmonary disease, severe spasticity, asymmetric hip positions. Individuals who regularly bear weight bear during transfers (either with or without braces) so that we are using people who are accustomed to bearing weight on their lower limbs The subjects who have experience in using some kind of walking assistive devices in the past or recently will be recruited. Subjects must have at least one lower limb muscle group respond to FES. Inclusion criteria for persons without SCI: Subjects will be included if they are between the ages of 18 and 60 and weigh less than 220 lbs (100kg). Healthy, are able to walk normally, are able to sit patiently for 4 hours. People who pass an assessment of safety by Dr. Cleveland. This would be a screen done by Dr. Cleveland after consent to determine if person is eligible. The proposed research will exclude children and pregnant women. We first aim to collect research data from adults as the proposed methods in the study have not been investigated on children and pregnant women. Exclusion criteria for persons with SCI: Subjects with other neuromuscular disease such as polio, stroke or multiple sclerosis. Persons with heart conditions and pacemakers will be excluded. Concurrent severe medical disease, pressure sores, open wounds, existing infection, unstable spine, unhealed limb or pelvic fractures, history of recurrent fractures, known orthopedic injury to lower extremities, and osteoporosis. Subjects with SCI who have open wounds, weight if with weight exceeds more than 220lb (100kg) Subjects with SCI with insufficient knee or hip range of motion, i.e. contractures will be excluded. If someone has contractures it may not be possible, or safe, for them to be in the device. Persons who do not have following minimum joint angle range of motion: knee flexion from 0-80°, hip flexion from 0-45° and hip extension 0-10° will be excluded. Subjects who find FES uncomfortable or painful; particularly, FES of the quadriceps muscle, hamstrings muscle, and ankle muscles. Exclusion criteria for persons without SCI: 1. A history of a neurological or an orthopedic disease that hampers normal lower limb movement 2. Persons with heart conditions and pacemakers will be excluded. 3. Any difficulty or an orthopedic condition that would impede knee extension 4. Absent sensation in lower leg 5. Subjects who find FES uncomfortable or painful; particularly, FES of the quadriceps muscle, hamstrings muscle, and ankle muscles.

IPD will not be shared outside of this research group. However, selected data may be published in academic journals, conference papers, or other publications. This data will be de-identified, and will not include the full set of data.

Bao X, Kirsch N, Dodson A, Sharma N. Model Predictive Control of a Feedback-Linearized Hybrid Neuroprosthetic System With a Barrier Penalty. J Comput Nonlinear Dyn. 2019 Oct 1;14(10):101009-1010097. doi: 10.1115/1.4042903. Epub 2019 Sep 9.

Kirsch NA, Bao X, Alibeji NA, Dicianno BE, Sharma N. Model-Based Dynamic Control Allocation in a Hybrid Neuroprosthesis. IEEE Trans Neural Syst Rehabil Eng. 2018 Jan;26(1):224-232. doi: 10.1109/TNSRE.2017.2756023. Epub 2017 Sep 22.

Alibeji NA, Molazadeh V, Dicianno BE, Sharma N. A Control Scheme That Uses Dynamic Postural Synergies to Coordinate a Hybrid Walking Neuroprosthesis: Theory and Experiments. Front Neurosci. 2018 Apr 10;12:159. doi: 10.3389/fnins.2018.00159. eCollection 2018.

Alibeji NA, Kirsch NA, Sharma N. A Muscle Synergy-Inspired Adaptive Control Scheme for a Hybrid Walking Neuroprosthesis. Front Bioeng Biotechnol. 2015 Dec 21;3:203. doi: 10.3389/fbioe.2015.00203. eCollection 2015.

Kirsch N, Alibeji N, Fisher L, Gregory C, Sharma N. A semi-active hybrid neuroprosthesis for restoring lower limb function in paraplegics. Annu Int Conf IEEE Eng Med Biol Soc. 2014;2014:2557-60. doi: 10.1109/EMBC.2014.6944144.