Abstract
In this study, a numerical framework for joint rotation configuration models of a finger is proposed. The basic idea is to replicate the finger’s geometric posture observed when the human hand grasps a cylindrical object with various cross sections. In the model development, objects with the cross section adopted from the curves of order two (the family of conic sections) are taken into consideration to realize various finger postures. In addition, four different grasp styles, which simulate the individual-specific contact pattern between the surfaces of object and finger, are modeled and applied for the formulation of numerical models. An idea on how to change flexion/extension patterns in the middle of excursion of movement is proposed and discussed. Series of numerical studies have been conducted and analyzed to evaluate the proposed models. From the results, one can see the models’ feasibility and viability as a solution to describing finger’s flexion/extension movements (FEMs) for grasping patterns.
1 Introduction
There have been many needs on simulating flexion and/or extension of fingers in various areas of applications—medicine and rehabilitation, prosthetics, artificial hands, robotics, man–machine interface device, human–computer interaction, and so on. Following the needs, a numerous research have been conducted in regard to human fingers simulation [1], finger motion coordination [2–4], virtual hand modeling and simulation [5–9], and articulated human hand [10,11].
In the model development, the following two aspects should be taken into consideration to fully describe flexion/extension functions of a finger: (1) joint rotation configuration in the viewpoint of inter-joint coordination and (2) the pattern with which a finger moves during the excursion of flexion/extension movement. Joint rotation configuration is related to the calculation of joint rotation angles in the stage of finger motion. The pattern is related to the mode of behavior of the finger during the flexion and/or extension.
In our recent work [9], the authors proposed a geometric approach to the development of a finger kinematic model for joint rotation configuration. Based on the finger posture observed when the hand grasps round-shaped cylinders, the geometric relations between the finger and the object are taken into consideration and the formula for joint rotation angle calculation is derived for each joint. The advantage of the model is that it provides three independent formulas for calculating the rotational angle of each joint, and only one parameter is involved for determining joint rotation configuration of a finger during flexion and/or extension. This allows the model to be utilized to robotic finger/hand control system design for multi-finger coordination. It is noted from motion capture experiments that the proposed model can simulate a naturalistic behavior of an index finger of the human hand as closely as possible.
On the basis of the recent research, the authors propose a numerical framework for joint position configuration of a finger by diversifying the shape of the virtual object being grasped and the way by which a finger encompasses the object. The model proposed in the preceding paper [9] deemed adequate to describe a grasping motion with a full fist, yet showed some inadequacy to describe a pinching motion that required in fine robot hand manipulation. While the grasping motion, a good fundamental of a robot hand manipulation, a robot requires a pinching motion as well. Such an alternative grasping motion allows a fine manipulation that complements the large workspace that a conventional grasping motion possesses and further allows better-grasping capability for elongated objects such as books. The proposed model describes well of the listed motion, while it shares the same manipulation method as the proposed motion from the previous research.
In the present work, the authors consider various virtual objects with different shapes of cross sections taken from curves of order two (conic sections)—circle, ellipse, parabola, and hyperbola. The equation of each curve is involved as one geometric condition in the numerical model. The fundamental of complex gesture of the hand resides in grasping motion in circular “frame” for many of the shapes can be inscribed in a circle. To tightly grasp the object being manipulated, the proposed method with different contact patterns can be applied. Thus, a cylindrical assumption lays the groundwork for further manipulation. During the grasping motion, each phalanx may abduct or adduct to their needs. If the object of interest can be hypothesized to be a cylindrical object, a cross section that denoted by an operational plane, formed by points of metacarpophalangeal (MCP), proximal interphalangeal (PIP), and distal interphalangeal (DIP), forms one of the listed shapes, i.e., a circle, an ellipse, a parabola, and a hyperbola. Thus, each finger can be coordinated to its corresponding cross section. Another consideration in the development of the model is to formularize the way the hand and object come into contact. Four different contact types (referred to as a grasp style, hereafter) are modeled and investigated.
It is noted that although the advantages and their modeling directions of the previous researches are best explained, this work focuses on the expansion of our previous work and the establishment of geometry-based numerical finger kinematic models. This article is organized as follows. In Sec. 2, a numerical framework for geometry-based finger kinematic models that can determine the joint angle configuration of the index finger is proposed. By introducing various virtual objects with different cross sections taken from curves of order two and grasp styles, numerical models corresponding to objects each by contact methods are developed. In Sec. 3, the results from numerical simulation studies are discussed. Section 4 proposes a method to deal with a flexion/extension pattern transition during the excursion of the finger movement. Finally, Sec. 5 concludes this paper with the summary of the work.
2 Numerical Framework for Joint Angle Configuration Models
2.1 Numerical Model Structure.
The notion adopted to develop joint angle configuration models is based on the geometric finger posture, which may be observed when an index finger softly encompasses the surface of a virtual cylindrical object (see Fig. 1). For the models development on the basis of the notion mentioned earlier, the authors adopted the structure of joint angle calculation process introduced in our previous work [9], as shown in Fig. 2.
In the Cartesian position part, there are three blocks each of which is corresponding to the ith phalanx and provides its Cartesian position. Each block consists of four equations: equation E1 is related to the shape of virtual object being grasped—an equation of cross section; equations E2 and E3 are to the geometry of phalanx—length of phalanx and thickness of joint (i.e., distance from surface to skeleton), respectively; equation E4 is to grasp style by which the finger encompasses an object.
The joint angles of a finger can be obtained in the Rotation position part via trigonometric formulas with the Cartesian position provided.
2.2 Virtual Objects With Conic Sections.
To have finger kinematic models for the joint angle configuration, the authors deal with cylindrical objects with the cross section constructed by a conic section (or conic).
A conic section is obtained from the intersection of a right circular cone with a plane. There are four types of conic sections: circle, ellipse, parabola, and hyperbola.
The information about the family of conic sections for a right circular cone is summarized in Table 1 [12].
Circle | Ellipse | Parabola | Hyperbola | |
---|---|---|---|---|
Eq. | ||||
d | 0 | c | f | c |
l | ∞ | −f | ||
e | 0 | 1 | ||
p | R | 2f | ||
CP | R | a, c | f | a, c |
Remarks | – | b2 = a2 − c2 | – | b2 = c2 − a2 |
Circle | Ellipse | Parabola | Hyperbola | |
---|---|---|---|---|
Eq. | ||||
d | 0 | c | f | c |
l | ∞ | −f | ||
e | 0 | 1 | ||
p | R | 2f | ||
CP | R | a, c | f | a, c |
Remarks | – | b2 = a2 − c2 | – | b2 = c2 − a2 |
Note: Fi, focus; Vi, vertex; d, focal distance; l, directrix; e, numerical eccentricity; p, semi-latus rectum; CP, shape parameter.
Five types of right cylindrical objects with different cross sections are considered in deriving geometric finger kinematic models for the joint angle configuration: cylinder, cylindroid, parabolic cylinder, hyperbolic cylinder, and triangular prism. It is noted that the triangular prism is also taken into consideration, since its cross section can be constructed from the asymptote of a hyperbola.
2.3 Grasp Style Modeling.
In the model development, four different grasp styles are modeled and introduced to consider diversity of individual-specific flexion movements as shown in Fig. 3.
Joint angle configuration models are used to provide the joint angles of a finger during flexion and/or extension movement. In the model point of view, the angles are calculated by the Cartesian positions of phalangers.
Along grasp styles, the way with which an object and fingers come into contact is varied in determining the position of each joint.
These styles can be characterized by the “slope condition” among lines defined on the object and phalangers.
Before proceeding, a basic notation is given first. F is the focus (or center) of a conic section. is the intersection point on the conic corresponding to the point on the phalanx i. A0I, A1I, and A2I are the points attached to MCP, PIP, and DIP joints, respectively. A3I represents the fingertip.
Based on the notation earlier, the following lines (or line segments) are defined: , , lTi is the tangent line on AiI′, lPi is a line in parallel with the phalanx i and . Subscript I represents the index finger.
With the lines (or line segments) defined earlier, the grasp styles shown in Fig. 3 can be described by the relationship among lines (referred to as “slope condition,” hereafter) shown in Table 2. Note that in grasp style models M0 and M1, lines defined on the object being grasped are mainly taken into consideration (i.e., related to the object shape); on the other hand, M2 and M3 feature lines defined outside of the object (i.e., related to the finger shape). Furthermore, it is noted that the method M0 is introduced in our previous work [9].
2.4 Systems of Nonlinear Equations for Numerical Simulation.
For joint angle calculation of the finger grasping an object with a circular cross section, Table 3 lists the system of nonlinear equations for joint angle calculation of phalanx i, which incorporates grasp styles adopted each. The explanation on each equation E1 – E4 is given in Sec. 2.1. The slope condition in Table 2 of each grasp style modeling can be formulated by slopes of lines defined in Sec. 2.3. The slopes of lines defined here are given in Table 3.
For objects with various cross sections, E1 and the object (cross section)-dependent slopes sF2Ii and sTi (encompassed in the solid box) in Table 3 can be replaced with ones in Table 4. Note that the slopes sF2Ii and sTi are calculated by the lines defined on the object at hand.
Conic | E1 | sF2Ii | sTi |
---|---|---|---|
Circle | |||
Ellipse | |||
Parabola | |||
Hyperbola | |||
Triangle |
Conic | E1 | sF2Ii | sTi |
---|---|---|---|
Circle | |||
Ellipse | |||
Parabola | |||
Hyperbola | |||
Triangle |
To achieve a joint angle configuration of a finger via systems of equations in Tables 3 and 4, one needs to rely on numerical methods to obtain solutions of the equations due to their nonlinear features. Figure 2 shows how the joint angle of each joint of MCP, PIP, and DIP, respectively, is calculated in the consecutive order. It is worth to note that the model has one degree-of-freedom that is capable of describing the joint rotation configuration of an index finger (with three degrees of rotation freedom) by a single shape parameter listed in Table 5. The shape parameter can be called the control parameter since the shape parameter can be used to change its shape of the cross section in the control point of view.
3 Numerical Simulation Results
By using systems of nonlinear equations presented in Tables 3 and 4, numerical simulations have been carried out to see the behavior of the finger movement under a virtual grasping of the cylindrical object with a specific cross section. The control parameter listed in Table 5 was used to control the shape of each cross section. Four different grasp type models are adopted for objects each during the numerical simulation study. Simulations have been run following the joint angle calculation process as shown in Fig. 2.
The following anthropometric values of the semi-thickness and phalanx’s length of the index finger under consideration are used for simulation: t0I = 1.5, t1I = 1.31, t2I = 0.94, t3I = 0.49, L1 = 4.54, L2 = 2.29, and L3 = 1.76 (unit, cm). These values were taken from a specific subject participated in this study.
Figures 4–9 depicts the simulated motion derived by solving the equations. Plots on the left side exemplify the finger motion of each corresponding grasp style, whereas the right side illustrates the continuous stepwise posture for each of four grasp styles. Figure 10 provides fingertip trajectory comparison by methods for respective object of different cross sections. The following notion can be drawn from the observation of simulation results:
The selection of a specific contact method can be made depending on the shape of object being grasped. It means that it needs not to apply an identical method to all objects with different cross sections.
For objects with round-shaped cross sections, such as circles and ellipses, the choice of method M0 is preferred in the viewpoint of geometrical naturalness in posture.
For objects with cross sections of a general curve (shape), there may be a limitation to the use of method M1, since it is not trivial to get the tangent formula of the curve.
For objects with a small size, methods M2 and/or M3 cannot be applied since there are cases of “no-contact” between object and finger.
As long as fingertip trajectory comparison, the locus of fingertip calculated by method M2 (M0) is large in closed (open)-curve cross sections.
4 Flexion/Extension Movement Pattern and Its Transition
The basic motion in fingers include flexion and extension. Grasping motion can be realized through a series of finger motions along with different degrees of flexion and/or extension. In the previous sections, joint angle configuration models for realizing FEM of a finger have been derived by assuming that fingers encompass a cylindrical object with the cross section taken from the family of conic sections. In this section, the authors investigate a method to deal with a FEM pattern change during the excursion of finger movement. Here, the FEM pattern can be defined as one that is observed during the behavior of grasping a cylindrical object with a specific cross section. Six patterns are discussed in this study (see Figs. 4–9).
The main notion of the FEM pattern change is based on the following scenario. During a flexion/extension motion of a finger with a given FEM pattern, one needs to change the current FEM pattern with another for performing specific grasping tasks. The basic idea proposed here is to use the semi-latus rectum p, which is one of the common characteristic features of the conic sections. Latus rectum is a chord perpendicular to the axis of the conic section through the focus and whose end pairs lie on the conic section (refer to Table 1). Figure 11 shows the different conic sections with the same value of p. This value is used as a reference to the starting posture of the new pattern, which will be discussed later.
Before proceeding, a twofold structure is introduced to make the description of FEM pattern changes simple. is a mathematical construct that represents the equation of a conic section. This consists of two parts: (1) is the type of cross section of the object being grasped and (2) is the shape parameter of a cross section and is controlled over time during flexion/extension movements. The capital letters C, E, P, H, and T represent a circle, an ellipse, a parabola, a hyperbola, and a triangle, respectively.
Independent to previous formation (i.e., pattern), a transformation is made from utilizing the identical p value that achieved from Eq. (1). At t = tt, the coordinates of each joint in the finger is obtained by solving the systems of nonlinear equations including . This is the starting posture of the finger with the newly changed pattern. After t > tt, flexion and/or extension are performed under the newly changed pattern defined by with the profile of shape parameter . Table 6 lists equations of cross sections with the shape parameter utilized during the pattern change. Figure 13 shows two examples of pattern change. Depending on the preceding pattern, the transition of finger posture can be either forward or backward at the time of transition. It is because that the succeeding patterns are defined with the semi-latus rectum obtained from the preceding pattern during the pattern change. It is worth to note that during pattern changes, the contact methods described in Sec. 2.3 can also be changed in parallel strategically if needed. Furthermore, it is noted that the notion discussed can be adopted to grasping strategies and object manipulation processes [4,13–20].
Equation | Shape parameter in | Shape parameter in | |
---|---|---|---|
at t = tt | at t > tt | ||
Circle | , p = R (given) | ||
R(t) = p | |||
Ellipse | , p = R (given), | , | |
for fixed e, | for fixed e, | ||
, | |||
(a > b) | (a > b) | ||
, | |||
(a < b) | (a < b) | ||
Parabola | , p = R (given) | ||
Hyperbola | , p = R (given) | ||
a(t) = t0I : fixed | a(t) = t0I : fixed | ||
Triangle | ↑ | ↑ | |
Equation | Shape parameter in | Shape parameter in | |
---|---|---|---|
at t = tt | at t > tt | ||
Circle | , p = R (given) | ||
R(t) = p | |||
Ellipse | , p = R (given), | , | |
for fixed e, | for fixed e, | ||
, | |||
(a > b) | (a > b) | ||
, | |||
(a < b) | (a < b) | ||
Parabola | , p = R (given) | ||
Hyperbola | , p = R (given) | ||
a(t) = t0I : fixed | a(t) = t0I : fixed | ||
Triangle | ↑ | ↑ | |
Note: e is the numerical eccentricity.
5 Conclusions
Extrapolated from real finger posture observed when the human hand grasps a cylindrical object with various cross sections, a numerical framework for joint rotation configuration of a finger has been proposed. The structure of the model consists of a set of systems of nonlinear equations that describe geometric conditions between the phalangers of a finger and the object being grasped. One of conditions to be considered is the shape of object being grasped, each of which is taken from conic sections. Four types of contact methods are taken into consideration in the model development as well. Joint rotation configurations of a finger have been obtained numerically by solving the sets of systems of nonlinear equations for objects with various cross sections by contact methods. Simulation studies and analyses have been conducted regarding the behavior of joint rotation configurations during flexion/extension movements. The simulation results show the possibility of the models to be used in replicating grasping behaviors of the human hand and in robotic/artificial hands design. Future work includes the consideration of objects with cross sections from the curve of order four (quartics) to explore ways of describing various grasping patterns.
Acknowledgment
The authors gratefully acknowledge the support of NSF CAREER award Id # 1751770.
Data Availability Statement
The datasets generated and supporting the findings of this article are obtainable from the corresponding author upon reasonable request. The authors attest that all data for this study are included in the paper. Data provided by a third party listed in Acknowledgment. No data, models, or code were generated or used for this paper.