In order to ensure safe and comfortable human–robot navigation in close proximity, it is imperative for robots to possess the capability to understand human behavioral intention. With this objective in mind, this paper introduces a Human-Aware Navigation (HAN) algorithm. The HAN system combines insights from studies on human detection, social behavioral model, and behavior prediction, all while incorporating social distance considerations. This information is integrated into a layer dedicated to human behavior intention cognition, achieved through the fusion of data from laser radar and Kinect sensors, employing Gaussian functions to account for individual private space and movement trend. To cater to the mapping requirements of the HAN system, we have reduced the computational complexity associated with traditional multilayer cost map by implementing a “first-come, first-served” expansion method. Subsequently, we have enhanced the trajectory optimization equation by incorporating an improved dynamic triangle window method that integrates human behavior intention cognition, leading to the determination of an appropriate trajectory for the robot. Finally, experimental evaluations have been conducted to assess and validate the efficacy of the human behavior intention cognition and the HAN system. The results clearly demonstrate that the HAN system outperforms the traditional Dynamic Window Approach algorithm in ensuring the safety and comfort of humans in human–robot coexistence environments.

This research offers an adaptive model-based methodology for autonomous control of 3-RRR spherical parallel manipulator (RSPM) based on a novel modeling framework. RSPM is an overconstrained parallel mechanism that has a variety of applications in medical procedures such as ankle rehabilitation because of its precision and accuracy. However, obtaining a complete explicit dynamic model of these mechanisms for tracking purposes has been a problematic challenge due to their inherent singularities, coupling effects of the limbs, and redundant constraints imposed by the intermediate joints. This paper presents a novel algorithm to obtain the analytical kinematic solutions of RSPMs based on the closed-loop vector method, which includes constraint analysis. By incorporating constrained kinematics into the dynamic model, a comprehensive explicit dynamic solution of the non-overconstrained version 3-RCC of RSPM is developed in task space, based on screw theory and the linear homogeneous property of algebraic equations on the manipulator twist. Based on the proposed computational framework, a robust self-tuning backstepping control (STBC) strategy is applied to the robot to overcome the effect of external disturbances and time-varying uncertainties. Furthermore, an observer-based compensation (OBC) method is presented for dealing with the nonlinear hysteresis loops of the ankle during trajectory tracking purposes. The closed-loop stability of the whole system including STBC and OBC is theoretically performed by Lyapunov methods. The proposed methodologies are validated by realistic co-simulations in different scenarios. For instant, in the presence of external disturbances, the maximum tracking error norm of STBC is 37.5% less than the sliding mode approach.

In order to resolve redundancy and path planning of a high DOF mobile manipulator using conventional approaches like Jacobian and a pseudoinverse method, researchers face the limitation of computational load and delay in response. If such kind of mobile manipulator is traversing the rough terrain, then conventional methods become too costly to implement due to the handling of redundant joints, obstacles, and wheel-terrain interaction. A few optimization-based redundancy resolution approaches try incorporating wheel-terrain interaction but fail in real-time response. This paper describes a 14 DOF Rover Manipulator System’s end-effector path-tracking approach using CG-Space framework to incorporate wheel-terrain interaction. CG-Space means the center of gravity (CG) locus of the Rover. The Rover’s CG is calculated while traversing over 3D terrain using a multivariable optimization method and a 3D point cloud image of the actual terrain and stored as CG-Space over the given terrain. First of all, we decide which part of the system moves to track the path, that is, arm or Rover, depending upon the manipulator’s work volume and manipulability measure restrictions. The next task is to obtain the Rover pose according to the end-effector path using a simple arm’s inverse kinematic solution between the CG-Space and end-effector task space without resolving redundancy. Meanwhile, obstacles and non-traversable regions are avoided in CG-Space. On diverse 3D terrains, simulation and experimental results support the suggested CG-Space framework for end-effector tracking.

This paper mainly studies an autonomous path-planning and real-time path-tracking optimization method for snake robot. Snake robots can perform search and rescue, exploration, and other tasks in a variety of complex environments. Robots with visual sensors such as LiDAR can avoid obstacles in the environment through autonomous navigation to reach the target point. However, in an unstructured environment, the navigation of snake robot is easily affected by the external environment, causing the robot to deviate from the planned path. In order to solve the problem that snake robots are easily affected by environmental factors in unstructured environments, resulting in poor path-following ability, this paper uses the Los algorithm combined with steering control to plan the robot in real time and control the robot’s steering parameters in real time, ensuring that the robot can stably follow the planned path.

Over decades of robotics research, cooperative object transportation has been studied as a meaningful model problem for robotic networks because it possesses a variety of crucial challenges. Although these challenges are demanding, the cooperation of multiple robots has the potential to solve automation problems that are beyond the scope of an individual robot. So far, the model problem has mostly been addressed by explicitly controlling the robots’ positions. However, the position-based approach suffers from some intrinsic detriments, for example, the lack of explicit feedback between robots and object. Moreover, it remains an open question how many robots shall be employed to ensure a successful transportation. This paper’s purpose is to overcome these challenges using a novel force-based approach taking into account the robots’ actual manipulation capabilities, that is, the exerted forces. Using cost-efficient hardware, the interaction forces are measured and, what is more, explicitly controlled by a highly responsive onboard controller. Employing a tailored software architecture, the novel force-based scheme, useful for robotic manipulation beyond the benchmark problem, is probably the most flexible of its kind regarding the number of robots and the object’s shape. The controller’s functionality and performance as well as the scheme’s versatility are demonstrated by several hardware experiments.

Diabetic retinopathy (DR) is a complication of diabetes that causes blindness and the early detection of diabetics using retinopathy images remains a challenging task. Hence, a novel, earlier smart prediction of diabetic retinopathy from fundus image under Innovative ResNet Optimization is introduced to effectively detect the earlier stage of DR from Fundus image. Initially, the fundus image is scaled during preprocessing and converted into a grayscale format. As the existing studies neglect some deserving unique features that are crucial for predicting the earliest signs of DR, a novel Fractional Radon Transform with Visibility Graph is introduced for extracting the novel features such as microaneurysms count, dot and blot hemorrhages count, statistical measures, and retinal layer thickness, in which a Generalized Cosine Fractional Radon Transform is used to capture the image’s fine-scale texture information thereby effectively capturing the statistical measures, while a weighted Horizontal Visibility Graph is made to examine the apparent spatial relationships between pixel pairs in the image based on the values of the pixels’ gray levels. Further, the existing works failed to identify the small fine dark areas that were ignored throughout the morphological opening process. In order to overcome this issue, a Morphological Black Hat Transform with Optimized ResNet Algorithm is implemented, where segmentation is made through Enriched Black Hat Transform-based Morphological operation to identify fine dark regions among the pixels inside the eye samples, and the classification is done by using ResNet-driven S-GOA (Socio Grasshopper Optimization Algorithm), to optimally predict the stages of DR. The result obtained showed that the proposed model outperforms existing techniques with high performance and accuracy.

The venous blood test is a prevalent auxiliary medical diagnostic method. Venous blood collection equipment can improve blood collection’s success rate and stability, reduce the workload of medical staff, and improve the efficiency of diagnosis and treatment. This study proposed a rigid-flexible composite puncture (RFCP) strategy, based on which a small 7-degree-of-freedom (DOF) auxiliary venipuncture blood collection (VPBC) robot using a trocar needle was designed. The robot consists of a position and orientation adjustment mechanism and a RFCP end-effector, which can perform RFCP to avoid piercing the blood vessel’s lower wall during puncture. The inverse kinematics solution and validation of the robot were analyzed based on the differential evolution algorithm, after which the quintic polynomial interpolation algorithm was applied to achieve the robot trajectory planning control. Finally, the VPBC robot prototype was developed for experiments. The trajectory planning experiment verified the correctness of the inverse kinematics solution and trajectory planning, and the composite puncture blood collection experiment verified the feasibility of the RFCP strategy.

Simultaneous localization and mapping systems based on rigid scene assumptions cannot achieve reliable positioning and mapping in a complex environment with many moving objects. To solve this problem, this paper proposes a novel dynamic multi-object lidar odometry (MLO) system based on semantic object recognition technology. The proposed system enables the reliable localization of robots and semantic objects and the generation of long-term static maps in complex dynamic scenes. For ego-motion estimation, the proposed system extracts environmental features that take into account both semantic and geometric consistency constraints. Then, the filtered features can be robust to the semantic movable and unknown dynamic objects. In addition, we propose a new least-squares estimator that uses geometric object points and semantic box planes to realize the multi-object tracking (SGF-MOT) task robustly and precisely. In the mapping module, we implement dynamic semantic object detection using the absolute trajectory tracking list. By using static semantic objects and environmental features, the system eliminates accumulated localization errors and produces a purely static map. Experiments on the public KITTI dataset show that the proposed MLO system provides more accurate and robust object tracking performance and better real-time localization accuracy in complex scenes compared to existing technologies.

The concept of distance between two rigid-body poses is important in path planning, positioning precision, mechanism synthesis, and in many other applications. In the definition of such a distance, two approaches mainly prevail, which lead to a number of formulas devised to match the needs of motion tasks. Despite the different approaches and formulas, some important theoretical results, which drive toward distance-metrics definitions useful for design and application purposes, have been stated. This paper summarizes the two different approaches together with a critical review of the literature on the distance metrics they generated, and, then, it illustrates a technique, previously proposed by the author, for combining different metrics to obtain novel distance-metric definitions that are tailored to specific applications.

Safe and socially compliant navigation in a crowded environment is essential for social robots. Numerous research efforts have shown the advantages of deep reinforcement learning techniques in training efficient policies, while most of them ignore fast-moving pedestrians in the crowd. In this paper, we present a novel design of safety measure, named Risk-Area, considering collision theory and motion characteristics of different robots and humans. The geometry of Risk-Area is formed based on the real-time relative positions and velocities of the agents in the environment. Our approach perceives risk in the environment and encourages the robot to take safe and socially compliant navigation behaviors. The proposed method is verified with three existing well-known deep reinforcement learning models in densely populated environments. Experiment results demonstrate that our approach combined with the reinforcement learning techniques can efficiently perceive risk in the environment and navigate the robot with high safety in the crowds with fast-moving pedestrians.

Evolution has shown that legged locomotion is most adequate for tasks requiring versatile movement on land, allowing animals to traverse a wide variety of environments ranging from natural terrain to artificial, man-made landscapes with great ease. By employing well-designed control schemes, this ability could be replicated for legged robots, enabling them to be used in critical situations that still pose great danger to human integrity, such as search and rescue missions, inspection of hazardous areas, and even space exploration. This work characterizes the quadruped robot and contact dynamics that will compose our in-house simulator to be used for prototyping locomotion control schemes applied to quadruped robots. The proposed simulator computes the robot dynamics using the Recursive Newton-Euler and Composite-Rigid-Body algorithms with a few modifications to make certain aspects relevant for contact detection and control more easily accessible; furthermore, a compliant contact force method alongside stick-slip friction modeled the contact dynamics. To allow the robot to move, a simple PD-independent joint controller was implemented to track a desired leg trajectory. With the same robot and controller implemented using the MuJoCo simulation software, this work evaluates the proposed simulator by comparing characteristic locomotion signals such as the trunk pose and the ground reaction forces. Results showed similar behavior for both simulators, especially with regard to the contact detection, despite the significantly different contact models. Lastly, final remarks to enhance our simulator’s performance are suggested to be explored in future works.

This paper deals with generally routed, pre-bent cable-driven continuum robots (CCR). A CCR consists of a flexible backbone to which multiple disks are attached. Cables are passed through holes in the disk, and when pulled, the flexible backbone and the CCR can attain different shapes based on their routing and backbone configuration. An optimization-based approach, using minimization of strain energy, is shown to give good results for the pose and motion of the CCR and to determine contact with external objects. The pose, motion, and the contact obtained from the model are shown to match very well with experimental results obtained from a 3D-printed CCR. An algorithm is proposed to generate the pre-bent backbone for a CCR which on actuation can attain the desired shape. Using the algorithm, three 3D-printed CCRs with pre-bent backbones are fabricated and these are used to demonstrate a compliant gripper that can grip a spherical object similar to that done by tentacles, and another three-fingered gripper with straight backbone CCRs is used to orient a square object gripped at the end.

In recent years, many microrobots have been developed for search applications using swarms in places where humans cannot enter, such as disaster sites. Hexapod robots are suitable for moving over uneven terrain. In order to use micro-hexapod robots for swarm exploration, it is necessary to reduce the robot’s size while maintaining its rigidity. Herein, we propose a micro-hexapod with an SU-8 rigid frame that can be assembled from a single sheet. By applying the SU-8 coating as a structure to the hexapod and increasing the rigidity, the substrate size can be reduced to within 40 mm × 40 mm and the total length when assembled to approximately 30 mm. This enables the integration of the micro electromechanical systems (MEMS) process into small and inexpensive hexapod robots. In this study, we assembled the hexapod with a rigid frame from a sheet created using the MEMS process and evaluated the leg motion.

The recognizing underwater targets is a crucial component of autonomous underwater vehicle patrols and detection efforts. In the process of visual image recognition in real underwater environment, the spatial and semantic features of the target often appear to different degrees of loss, and the scarcity of specific types of underwater samples leads to unbalanced data on categories. This kind of problem makes the target features appear weak and seriously affects the accuracy of underwater target recognition. Traditional deep learning methods based on data and feature enhancement cannot achieve ideal recognition effect. Based on the above difficulties, this paper proposes an improved feature enhancement network for weak feature target recognition. Firstly, a multi-scale spatial and semantic feature enhancement module is constructed to extract the feature information of the extraction target accurately. Secondly, this paper solves the influence of target feature distortion on classification through multi-scale feature comparison of positive and negative samples. Finally, the Rank & Sort Loss function was used to train the depth target detection to solve the problem of recognition accuracy under highly unbalanced sample data. Experimental results show that the recognition accuracy of the proposed method is 2.28% and 3.84% higher than that of the existing algorithms in the recognition of underwater fuzzy and distorted target images, which demonstrates the effectiveness and superiority of the proposed method.

This paper proposes a virtual reality-based dual-mode teleoperation architecture to assist human operators in remotely operating robotic manipulation systems in a safe and flexible way. The architecture, implemented via a finite state machine, enables the operator to switch between two operational modes: the Approach mode, where the operator indirectly controls the robotic system by specifying its target configuration via the immersive virtual reality (VR) interface, and the Telemanip mode, where the operator directly controls the robot end-effector motion via input devices. The two independent control modes have been tested along the task of reaching a glass on a table by a sample population of 18 participants. Two working groups have been considered to distinguish users with previous experience with VR technologies from the novices. The results of the user study presented in this work show the potential of the proposed architecture in terms of usability, both physical and mental workload, and user satisfaction. Finally, a statistical analysis showed no significant differences along these three metrics between the two considered groups demonstrating ease of use of the proposed architecture by both people with and with no previous experience in VR.

Hyper-redundant manipulators are produced by cascading several mechanisms on top of each other as modules. The discrete actuation makes their control easier because discrete actuators usually do not need any feedback to control. So far, several methods have been proposed to solve the inverse kinematic problem of discretely actuated, hyper-redundant manipulators. The two-by-two searching method is better than the other methods in terms of CPU time and error. In this article, the mentioned method is generalized by choosing an arbitrary number of modules as pending modules in each step of the solution instead of the necessary two. For validation, the proposed method is compared with nine meta-heuristic searching algorithms: simulated annealing, genetic algorithm, particle swarm optimization, ant colony optimization, gray wolf optimizer, stochastic fractal search, whale optimization algorithm, Giza pyramid construction, and flying fox optimization. Furthermore, the effect of the number of pending modules on CPU time and error is investigated. All the numerical problems have been solved for two case studies, one is planar and the other is spatial.

Thanks to its real-time computation efficiency, deep reinforcement learning (DRL) has been widely applied in motion planning for mobile robots. In DRL-based methods, a DRL model computes an action for a robot based on the states of its surrounding obstacles, including other robots that may communicate with it. These methods always assume that the environment is attack-free and the obtained obstacles’ states are reliable. However, in the real world, a robot may suffer from obstacle localization attacks (OLAs), such as sensor attacks, communication attacks, and remote-control attacks, which cause the robot to retrieve inaccurate positions of the surrounding obstacles. In this paper, we propose a robust motion planning method ObsGAN-DRL, integrating a generative adversarial network (GAN) into DRL models to mitigate OLAs in the environment. First, ObsGAN-DRL learns a generator based on the GAN model to compute the approximation of obstacles’ accurate positions in benign and attack scenarios. Therefore, no detectors are required for ObsGAN-DRL. Second, by using the approximation positions of the surrounding obstacles, ObsGAN-DRL can leverage the state-of-the-art DRL methods to compute collision-free motion commands (e.g., velocity) efficiently. Comprehensive experiments show that ObsGAN-DRL can mitigate OLAs effectively and guarantee safety. We also demonstrate the generalization of ObsGAN-DRL.

The early applications of Visual Simultaneous Localization and Mapping (VSLAM) technology were primarily focused on static environments, relying on the static nature of the environment for map construction and localization. However, in practical applications, we often encounter various dynamic environments, such as city streets, where moving objects are present. These dynamic objects can make it challenging for robots to accurately understand their own position. This paper proposes a real-time localization and mapping method tailored for dynamic environments to effectively deal with the interference of moving objects in such settings. Firstly, depth images are clustered, and they are subdivided into sub-point clouds to obtain clearer local information. Secondly, when processing regular frames, we fully exploit the structural invariance of static sub-point clouds and their relative relationships. Among these, the concept of the sub-point cloud is introduced as novel idea in this paper. By utilizing the results computed based on sub-poses, we can effectively quantify the disparities between regular frames and reference frames. This enables us to accurately detect dynamic areas within the regular frames. Furthermore, by refining the dynamic areas of keyframes using historical observation data, the robustness of the system is further enhanced. We conducted comprehensive experimental evaluations on challenging dynamic sequences from the TUM dataset and compared our approach with state-of-the-art dynamic VSLAM systems. The experimental results demonstrate that our method significantly enhances the accuracy and robustness of pose estimation. Additionally, we validated the effectiveness of the system in dynamic environments through real-world scenario tests.