Developing Humanoid Robot Animations in Motion Capture

Developing Humanoid Robot Animations in Motion Capture foot (Chapter 1)This research describes the fashion mystify in which the different serviceman movements read been turn bandagingn from doubtfulness capture and that information is animated which sets the direction to study the digital font models and its travel in the virtual purlieu. It excessively gives feasible approach in understanding of travel tempo patterns in that environment. This framework also leads to the study issues cerebrate to safety engineering.OverviewAnalysis of humanity loco doubt and its research argona utilisation up changed since it began form the cave drawings of the Paleolithic Era. The motive for human loco act studies at advance(prenominal) stages were driven by the need to carry on by resourcefully moving from place to place, dodging from predators and hunting for food (Alexander, 2000). Modern-day human loco relocation studies thrust added to a wide range of coats ranging from mil itary determination, sport, ergonomics, and health c ar. In loco deed studies, according to (H all(prenominal), 1991) the term biomechanicsbecame accepted during the early 1970s as the internationally recognized descriptor of the field of atomic number 18a concerned with the mechanical study of living organism. In sport, human loco head studies ar made to extend the restrictions of an jock when even the minimum improvement in performance is pursued eagerly (J. A. , 1984). However, the development of human locomotion studies remains reliant on the improvement of fresh tools for observation. According to (Alexander, 2000) lately, instrumentation and computer technology have grant opportunities for the improvement of the study of human locomotion. (J. A. , 1984).Illustrate frequent techniques for measuring motion and mentioned the co-ordinate analyzer (motion capture imposture) as a major advance in movement study. According to (Furniss, 2000) Motion capture or mocap was initiall y created for military use introductory than it was modified into the entertainment industry since the mid 1980.s. (Dyer, 1995) define motion capture as measuring an aims location and direction in physical space, so put down that sequence into a computer usable form. According to(Micheal, 2003) (Suddha Basu, 2005) motion capture is the fastest way to produce rich, realistic animation data. (James F OBrien, 2000) illustrate that Mocap smoke also be useful in several additional fields often(prenominal) as music, fine art dance, sign language, motion recognition, rehabilitation with medicine, biomechanics, e modified(a) effects for live-action films and computer animation of all types as well as in defense and athletic analysis/training. There atomic number 18 basically leash types of motion capture clays accessible such as mechanical, electromagnetic and opthalmic found system. All trinity systems go through the same basic regale shown in figure. The first step is the i nput where the movement of live actors either human or animal is recorded using various manner depending on the type of the motion capture system used. Next, the information is processed to identify the corresponding markers of the live actor and then transferred into virtual space using specialised computer softw are. Finally the output is where the information is translated into a 3D trajectory computer data that contains translation and rotation information known as motion capture file.MotivationProducing realistic character animation remains one of the great challenges in computer graphics. At present, there are terzetto methods by which this animation eject be produced. The first one is key framing, in which the vitaliser gives important key poses for the character at specific frames. A indorse one uses physical simulation to drive the characters motion its results are good, repayable to lack of control its difficult to use and its costly and with characters its not much successful. The hold one is motion capture, has been widely used to animate characters. It uses sensors placed on person and collects the data that describes their motion however they are performing the desired motion. As the technology for motion capture has improved and the cost decreased, the interest in using this approach for character animation has also increased. The main challenge that an animator is confronted with is to generate character animation with a realistic appearance. As android robot renovation is a popular research area since it female genital organ be used in various applications to understand the emerging field of robotics and other digital animation fields. Currently most of the methods work for controlled environments and human pose reconstructive memory to recognize mechanical man robots is a popular research area since it croup be used in various applications. Motion capture and motion tax deduction are expensive and clock time consuming tasks for a rticulated figures, such as humans. Human pose view based on computer vision beliefs is trashy and widely applicable approach. In computer vision literature the term human motion capture is commonly used in connection with grievous(a) scale body analysis ignoring the fingers, hands and the facial muscles, which is the case in this research. The motion capture is pretty problematic to calculate a 3D pinched representation of the motion of satisfactory value to be functional for animation. The animation generation is an application of motion capture where the required accuracy is not as graduate(prenominal) as in some other applications, such as medicine (Ferrier, June 2002)Problem Context1) Even though motion capture is utilise into so many fields by creating physically perfect motions, it has a few significant weaknesses. According to (Lee, MCML Mocap, 2004) firstly, it has low flexibility, secondly the captured data can have different data formats depending on the motion capture system which was employed and thirdly, commercially available motion capture libraries are difficult to use as they often include hundreds of examples. (Shih-Pin Chao, 2003) States that motion capture sessions are not only costly but also a labor intensive process thus, promotes the usability of the motion data.2) In the field of animation and gaming industry, it is common that motion information are captured to be used for a particular project or stored in a mocapdata. This data can either be used as the whole range of motion sequence or as part of a motion synthesis. In sport science, mocap data is used for analyzing and perfecting the sequencing mechanics of premier athletes, as well as monitoring the rec everyplacey progress of physical therapies. This hardly means that a vast collection of motion capture data models are restrain for different sets. Currently, motion data are often stored in small clips to allow for easy hand sequencing for describing the behavior (Jer nej Barbic, 2004) (Tanco L. M., 2000). However, according to (Lee, MCML Mocap, 2004) (Morales, 2001) (Tanco L. M., 2000) a motion capturedata models lack interoperability. This calls for an immediate need for tools that synchronize these datasets (Feng Liu, 2003).3) In light of the upstart course of interest in virtual environment applications, much research has been devoted to solving the problems of manipulating humans in 3-D simulated worlds, and especially to human locomotion. However, most of the animation approaches based on these studies can only generate limited approach lacking the locomotion capabilities for example walking their application in virtual environments are inevitably limited.Project ObjectiveThe objective of this project is to create a framework taken from motion capture data techniques which can set the direction to study 3D articulated figures and the humanoid robot locomotion in the virtual environment by understanding walking gait patterns in human. This framework also leads to the study issues related to safety engineering.The other objective of this project is to capture, process, and examine the locomotion feasibility in virtual environment and analyze different tasks in virtual environment.In system overview diagram all the different steps has been described it starts from mocaop suit that is on the subject and then its data of random movement has been taken into computer and motion analysis is done. After motion analysis its been retargeted and with avatar model the final output crack has been created. Then with software development kit feasible program has been created to deal with different information of that scene.Project ScopeTo capture the human motion from the motion capture technology and using the captured data to animate the different motions and then refining the animated data. By using the technology called motion builder we can simulate and study the effects of walk and fall in the virtual environment. After mappi ng the captured data in the animated character which is called digital humanoid robot an application is build to study the nature of the animated scene which is called an enhanced framework. The other technology is used is called mathematica which is used for studying the factors in mathematical terms because the human motion builder is a simulation technology and mathematica is a dynamic solver engine. So it will lead towards the study of digital humanoid robot of walking and falling in virtual environments on some assumptions.OutlineThis part outlines the in general structure of the thesis, and a rook explanation for each chapterChapter 1 deals with Introduction, scope and objective with problem context.Chapter 2 Introduces human motion capture techniques and different work in animation of human walking in virtual environment and gives a summary of the related work in this area.Chapter 3 deals with the system structure which describes the hardware and the software technologies i nvolved in the research and also illustrate the frame work model and this model help exploit the behavior of humanoid which sets up the framework.Chapter 4 describes the framework analysis based on the study of articulated animation models in virtual environment and walking gait patters with Bezier curve algorithm.Chapter 5 mention all the techniques that have been extracted from different softwares and how its used to set up the whole framework and evaluates results which are categorized in three phases the application which represents coordinate system and structure, walking gait patters by using Bezier curve and the falling effect by visual aid.Chapter 6 is the conclusion that summarizes the outcome of the project, and discusses the future works.ConclusionThis chapter describes the introduction of motion capture and how it will be utilized to improve the study of human locomotion. The project scope and objectives are elaborated and listed down in this chapter.Literature reassessm ent (Chapter 2)Motion capture systemMotion capture is an attractive way of creating the motion parameters for computer animation. It can provide the realistic motion parameters. It permits an actor and a director to work together to create a desired pose, that may be difficult to describe with enough specificity to have an animator recreate manually (Ferrier, June 2002). The application areas of motion capture techniques can be summarized as follows (Perales, 2001)Virtual reality interactive virtual environments, games, virtual studios, character animation, film, advertisingSmart watchfulness systems access control, parking lots, supermarkets, vending machines, traffic.Advanced drug user interfaces advanced user interfaces.Motion analysis and synthesis annotations of videos, personalized training, clinical studies of medicine.Understanding the working of humanoid robot has been always on study of human locomotion. This literature review discusses human motion control techniques, motion capture techniques in general and advance, non-vision based motion capture techniques, vision-based motion capture techniques with and without markers and other enhanced techniques which are covered in details for which the framework can be understood easily.Properties of trailing SystemsThis section lists properties of trailing systems and discusses the relationships between the various properties.AccuracyAccuracy can be defined as the agreement between the measured results from trailing technologies and the essential side of the object, and because the true value is unknown the continueing technologies can only be evaluated with relative accuracy. For one bring in system, the accuracy is limited by the principle and affected by the noise/interferences from the environment. The sources of noises are depending on the tracking technology we use. For different tracking principles, the influencing factors are different. For example, for optical motion tracking, the interfere nce is lighting and AC current for magnetic, ferrous objects distort the magnetic field and cause errors. If the model or the mechanism of the noise is quantitatively known, it is a systematic error and can be compensated by post-treatment after tracking or eliminated by pre-filtering before tracking.RobustnessRobustness defines the systems ability to continue to function in ill conditions or with missing or incorrect measurements. nearly systems make assumptions about the surrounding environment during operation. Also, a system may be unable to take a measurement at a particular time. Related to the robustness is repeatability in the reported data. If the reported values are consistent over time and over operating conditions and environment, then measuring the accuracy (or the lack thereof) is possible, and corrective algorithms can be applied.Tracking rangeThe range is the space in which the system can measure sufficient and accurate data for the application. For some systems, t he range can be reduced by noises from the environment or be limited by the hardware of the system itself. For example, magnetic system cannot track accurate data when the tracked object is at the margin of the magnetic field due to the inhomogeneous distribution of the field.Tracking speedTracking speed is the frequency at which the measurement system can obtain the updated tracking data. There are two significant numbers for the system, one is update rate and the other one is latency. Update rate is the frequency at which the tracking system generates the tracking data latency describes the delay between tracking data has been generated and the host computer receives the data in real time mode.HardwareThe hardware means the physical realization of the components of the tracking system. It includes the number of components, and the size and weight of those components, especially those that the user is required to carry (or wear). Some systems may have a significant marrow of hardw are that must be set up in the environment, although it may need no further attention from the user once in direct. Ideally, the application would like to give the user complete freedom of movement. Some devices tether the user to a flash-frozen object. Some systems may have a heavy or unwieldy device which the user must manipulate in order to move. Some devices have a tendency to pull the user back to a resting position for the device. The hardware also watch overs the biggest part of the costs and therefore is very often a decisive factor for the choice of the applied motion tracking systemNon-vision Based Motion CaptureIn non-vision based systems, sensors are machine-accessible to the human body to collect movement information. Some of them have a small sensing footprint that they can detect small changes such as finger or toe movement (Hu, A behold human movement tracking and stroke rehabilitation, 1996). Each kind of sensor has advantages and limitations (Hu, A comply h uman movement tracking and stroke rehabilitation, 1997).Advantages of magnetic trackersreal-time data output can provide immediate feedbackno post processing is requiredthey are less expensive than optical systemsno cube problem is observedmultiple performers are possibleDisadvantages of magnetic trackersthe trackers are sensitivity to metal objectscables restricts the performersthey provide lower sampling rate than some optical systemsthe marker configurations are difficult to changeAdvantages of electromechanical body suitsthey are less expensive than optical and magnetic systemsreal-time data is possibleno occlusion problem is observedmultiple performers are possibleDisadvantages of electromechanical body suitsthey provide lower sampling ratethey are difficult to use due to the amount of hardwareconfiguration of sensors is fixedVision-Based Motion Capture with MarkersIn 1973, Johansson explored his famous Moving Light Display (MLD) psychological experiment to distinguish biolo gical motion (Johansson). In the experiment, small reflective markers are attached to the joints of the human performers. When the patterns of the movements are observed, the integration of the signals coming from the markers resulted in recognition of actions. Although the method faces the challenges such as errors, non-robustness and expensive computation due to environmental constraints, mutual occlusion and complicated processing, many marker based tracking systems are available in the market. This is a technique that uses optical sensors, e.g. cameras, to track human movements, which are captured by placing markers upon the human body. Human skeleton is a highly articulated structure and moves in three-dimension. For this flat coat, each body part continuously moves in and out of occlusion from the view of the cameras, resulting in inconsistent and unreliable motion data of the human body. wholeness major drawback of using optical sensors and markers, they cannot sense joint rotation accurately. This is a major drawback in representing a real 3D model (Hu, A survey human movement tracking and stroke rehabilitation, 1997). Optical systems have advantages and limitations (Perales, 2001).Advantages of optical systems are as followsthey are more accuratelarger number of markers are possibleno cables restricts the performersthey produces more samples per secondDisadvantages of optical systemsthey require post-processingthey are expensive (between 100, 000 and 250, 000)occlusion is a problem in these systemsenvironment of the capturing must be away from yellow light and reflective noiseVision-Based Motion Capture without MarkersAs a less restrictive motion capture technique, markerless-based systems are able of overcoming the mutual occlusion problem as they are only concerned about boundaries or features on human bodies. This is an active and promising but also challenging research area in the last decade. The research with respect to this area is still on going (Hu, A survey human movement tracking and stroke rehabilitation, 1996). The markerless-based motion capture technique exploits external sensors like cameras to track the movement of the human body. A camera can be of a resolving forcefulness of a million pixels. This is one of the main reasons that optical sensors attracted peoples attention. However, such vision-based techniques require intensive computational power (Bryson, 1993). As a commonly used framework, 2D motion tracking only concerns the human movement in an stove plane, although sometimes people intend to project a 3D structure into its image plane for processing purposes. This approach can be catalogued with and without explicit shape models (Hu, A survey human movement tracking and stroke rehabilitation, 1996). The creation of motion capture data from a single video stream seems like a plausible idea. People are able to watch a video and understand the motion, but clearly, the computing the human motion para meters from a video stream are a challenging task (Ferrier, June 2002). Vision-based motion capture techniques usually include initialization and tracking steps.InitializationA system starts its operation with correct interpretation of the current scene. The initialization requires camera calibration, adaptation to scene characteristics and model initialization. Camera calibration is defined as parameters that are required for translating a point in a 3D scene to its position in the image. Some systems find initial pose and increment it from frame to frame whereas in other systems the user specifies the pose in every single frame. Some systems have special initialization phase where the start pose is found automatically whereas in others the same algorithm is used both for initialization and pose devotion (Granum, 2001).TrackingTracking phase extracts specific information, either low level, such as edges, or high level, such as head and hands. Tracking consists of three parts (Gran um, 2001)Figure-ground segmentation the human figure is extracted from the rest of the image.Representation segmented images are converted to another presentation to reduce the amount of information.Tracking over time how the subject should be tracked from frame to frame.MechanicalMechanical measurement is the oldest form of location rulers and tape measures provide a simple method of locating one item with reference to another. More sophisticated mechanical techniques have been developed. Nowadays measurements of the angles of the body joints with potentiometers or shaft encoders combined with knowledge of the dimensions of the besotted components allow accurate calculations of the position of different body parts.(Beresford, 2005)Today mechanical position tracking devices can be separated into body-based and ground-based systems.Body based systems are those which are attach on, or carried on, the body of the user and are used to sense either the relative positions of various par ts of the users body or the position of an instrument relative to a fixed point on the users body. Body-based systems are typically used to determine either the users joint angles for reproduction of their body in the synthetic environment, or to determine the position of the users hand or foot, relative to some point on the users body. Since the body based systems are used to determine the relative position between two of the users body parts, the devices must somehow be attached to the users body. This particular issue has raised many questions How is the device attached to the body in a way which will minimize relative motion between the attachment and the soft body part? How are the joints of the device aligned with the users joints to minimize the difference in the centers of rotation? Some other problems associated with body-based tracking systems are specifically caused by the device being attached to the users body. These systems are typically very obtrusive and encumbering and therefore do not allow the user complete freedom of movement. Body-based systems are, however, quite accurate and do not catch problems like measurement drift (the tendency of the devices output to change over time with no change in the feel quantity), interference from external electromagnetic signals or metallic devices in the vicinity, or shadowing (loss of comprehend of the tracked object due to physical interference of another object)(Frey, 1996).Ground based systems are not carried by the user but are mounted on some fixed surface (i.e. the users desk or the floor) and are used to sense the position of an implement relative to that fixed surface. Ground-based systems are typically used to determine the position and orientation of an implement manipulated by the user relative to some fixed point which is not on the users body. Like body-based mechanical systems, they are very accurate and are not plagued by measurement drift errors, interference or shadowing. Ground-base d systems do throw from one thing which the body-based systems do not They confine the user to work within the space allowed by the device. Usually this means that the user is confined to work in a space the size of a large desk. If the application does not require the user to move round much throughout the task (i.e. the user remains seated), this is not considered as a problem.Mechanical tracking systems are the best choice for force-feedback (haptic) devices since they are rigidly mounted to either the user or a fixed object. Haptic devices are used to allow the user a sense of touch. The user can detect surfaces in the synthetic environment or feel the weight of an object. The device can apply forces to the users body so that the user can experience a sense of exertion. Mechanical tracking systems also typically have low latencies (the time required to receive useful information about a sensed quantity) and high update rates (the rate at which the system can provide useful in formation). Therefore these systems have found good commercial nook as measurement devices and hand tracking systems.Advantageshigh update ratelow latencyaccurateNo blocking problem, no interference from environment best choice for force feedbackDisadvantagesRestricted movement from mounted deviceAcousticAcoustic tracking systems utilize high frequency sound waves to track objects by either the triangulation of several receivers (time-of-flight method) or by measuring the signals phase difference between transmitter and receiver (phase-coherence method).Generally the user carries the transmitter, and a serial publication of sensors around the room determine the linear distance to the transmitter. Some systems have the user carry a receiver and listen to a series of transmitters positioned around the volume.The time-of-flight method of acoustic tracking uses the speed of sound through air to calculate the distance between the transmitter of an acoustic pulse and the receiver of th at pulse. The use of one transmitter on a tracked object and a minimum of three receivers at unmoving positions in the vicinity allow an acoustic system to determine the relative position of the object via triangulation. This method limits the number of objects tracked by the system to one. An alternative method has been devised in which several transmitters are mounted at stationary positions in the room and each object being tracked is fitted with a receiver. Using this method, the positions of numerous objects may be heady simultaneously. Note that the use of one transmitter (or one receiver) attached to an object can resolve only position. The use of two transmitter (receiver) sets with the same object can be used to determine the position and orientation (6 DOF) of the object. The desire to track more than just the position of an object suggests that the second method (multiple stationary transmitters with body mounted receivers) may be preferable.The other method of acoustic tracking is the phase-coherent tracking. It may be used to achieve better accuracies than the time-of-flight method. The system does this by sensing the signal phase difference between the signal sent by the transmitter and that detected by the receiver. If the object being tracked moves further than one-half of the signal wavelength in any direction during the period of one update, errors will result in the position determination. Since phase coherent tracking is an additive form of position determination, small errors in position determination will result in larger errors over time (drift errors), which may be the reason why only few phase-coherent systems have been implemented successfully.Some problems associated with both acoustic tracking methods result from the line-of-sight required between transmitter and receiver. This line of sight requirement obviously plagues the devices with shadowing problems. It also limits their effective tracking range, although they have better tracking ranges than electromagnetic systems. Unlike electromagnetic systems, they do not suffer from metallic interference, but they are susceptible to interference caused by ambient noise sources, by reflections of the acoustic signals from hard surfaces, and environmental interference (e.g. temperature variations).AdvantagesVery high freedom of movementCheapDisadvantagesLine-of-sight problemsEither high range or high accuracy (not both)Environmental interference (e.g. temperature variations, other noise sources) bollocks up errors (phase-coherent)High latency, low update ratesMagneticElectromagnetic tracking systems are currently the most widely used systems for human body tracking applications. They employ the use of artificially-generated electromagnetic fields to induce voltages in detectors attached to the tracked object. A fixed transmitter and the sensors consist of three coils mounted in mutually orthogonal directions. The sensors range in size, but tend to be around a few cubic centimeters. The transmitters range in size with the power of the field they are expected to generate, and range from several cubic inches to a cubic foot. There are four magnetic fields that have to be measured the environmental field (including the Earths magnetic field), and three orthogonal fields in the transmitters coordinate directions in figure. Each of these fields is measured in the sensors three coordinate dimensions for a total of twelve measurements of each sensor. From this information, the position and orientation of the sensor with respect to the transmitter can be computed.These tracking systems are robust, fast, and fairly inexpensive and can be used to track numerous objects (body parts) with acceptable position and orientation accuracies (on the order of 0.1 inches and 0.5 degrees). Unlike electric fields, magnetic fields are unaffected by the presence or absence of human bodies and other non-metallic objects in the environment. This offers a tremendous op portunity, because it enables magnetic trackers to overcome the line-of-sight requirement that plagues acoustic, optical, and externally affiliated mechanical tracking systems. On the other hand, the magnetic systems suffer from sensitivity to background magnetic fields and interference caused by ferrous metal devices in the vicinity, and therefore is inaccurate in practical environments. Due to this and the limited range of the generated magnetic field, the magnetic tracking systems are restricted to a small special area.AdvantagesHigh update ratesVery low latencyHigh robustnessNo shadowingRather cheapAcceptable accuracy in artificial environmentDisadvantagesHigh sensitivity to background magnetic fieldsInaccurate in practical environments due to interference caused by ferrous metal devicesLow range of the magnetic field and Tracking scope is low due to cableInertialAn internal sensor contains three gyroscopes, to determine the angulate rate, and three accelerometers, to determine linear acceleration. Originally, they were mounted to orthogonal axes on a gimbaled platform, as it can be seen in figure. After removing the effect of temperance from the vertical accelerometer, the data has to be double-integrated to provide a measure of the offset between initialization and the current position. In fact, this combination of sensors has been used successfully for inertial navigatio