Dataset Information

Attention Based Visual Analysis for Fast Grasp Planning With a Multi-Fingered Robotic Hand.

ABSTRACT: We present an attention based visual analysis framework to compute grasp-relevant information which helps to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions of interest in a scene and employ a deep convolutional neural network to detect grasp type and grasp attention point for a sub-region of the object in a region of interest. We demonstrate the proposed framework with object grasping tasks, in which the information generated from the proposed framework is used as prior information to guide grasp planning. The effectiveness of the proposed approach is evaluated in both simulation experiments and real-world experiments. Experimental results show that the proposed framework can not only speed up grasp planning with more stable configurations, but also handle unknown objects. Furthermore, our framework can handle cluttered scenarios. A new Grasp Type Dataset (GTD) which includes six commonly used grasp types and covers 12 household objects is also presented.

SUBMITTER: Deng Z

PROVIDER: S-EPMC6684762 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Attention Based Visual Analysis for Fast Grasp Planning With a Multi-Fingered Robotic Hand.

Deng Zhen Z Gao Ge G Frintrop Simone S Sun Fuchun F Zhang Changshui C Zhang Jianwei J

Frontiers in neurorobotics 20190731

We present an attention based visual analysis framework to compute grasp-relevant information which helps to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions of interest in a scene and employ a deep convolutional neural network to detect grasp type and grasp attention point for a sub-region of the object in a region of interest. We demonstrate the proposed framework with object grasping tasks, in which the inform ...[more]

PMID: 31417391

Similar Datasets

Project description:PurposeTo propose and validate a fully automated multicriterial treatment planning solution for a CyberKnife® equipped with an InCiseTM 2 multileaf collimator.MethodsThe AUTO BAO plans are generated using fully automated prioritized multicriterial optimization (AUTO MCO) of pencil-beam fluence maps with integrated noncoplanar beam angle optimization (BAO), followed by MLC segment generation. Both the AUTO MCO and segmentation algorithms have been developed in-house. AUTO MCO generates for each patient a single, high-quality Pareto-optimal IMRT plan. The segmentation algorithm then accurately mimics the AUTO MCO 3D dose distribution, while considering all candidate beams simultaneously, rather than replicating the fluence maps. Pencil-beams, segment dose depositions, and final dose calculations are performed with a stand-alone version of the clinical dose calculation engine. For validation, AUTO BAO plans were generated for 33 prostate SBRT patients and compared to reference plans (REF) that were manually generated with the commercial treatment planning system (TPS), in absence of time pressure. REF plans were also compared to AUTO RB plans, for which fluence map optimization was performed for the beam angle configuration used in the REF plan, and the segmentation could use all these beams or only a subset, depending on the dosimetry.ResultsAUTO BAO plans were clinically acceptable and dosimetrically similar to REF plans, but had on average reduced numbers of beams ((beams in AUTO BAO)/(beams in REF) (relative improvement): 24.7/48.3 (-49%)), segments (59.5/98.9 (-40%)), and delivery times (17.1/22.3 min. (-23%)). Dosimetry of AUTO RB and REF were also similar, but AUTO RB used on average fewer beams (38.0/48.3 (-21%)) and had on average shorter delivery times (18.6/22.3 min. (-17%)). Delivered Monitor Units (MU) were similar for all three planning approaches.ConclusionsA new, vendor-independent optimization workflow for fully automated generation of deliverable high-quality CyberKnife® plans was proposed, including BAO. Compared to manual planning with the commercial TPS, fraction delivery times were reduced by 5.3 min. (-23%) due to large reductions in beam and segment numbers.

Project description:Stereotactic radiosurgery (SRS) is the accurate, conformal delivery of high-dose radiation to well-defined targets while minimizing normal structure doses via steep dose gradients. While inverse treatment planning (ITP) with computerized optimization algorithms are routine, many aspects of the planning process remain user-dependent. We performed an international, multi-institutional benchmark trial to study planning variability and to analyze preferable ITP practice for spinal robotic radiosurgery. 10 SRS treatment plans were generated for a complex-shaped spinal metastasis with 21 Gy in 3 fractions and tight constraints for spinal cord (V14Gy < 2 cc, V18Gy < 0.1 cc) and target (coverage > 95%). The resulting plans were rated on a scale from 1 to 4 (excellent-poor) in five categories (constraint compliance, optimization goals, low-dose regions, ITP complexity, and clinical acceptability) by a blinded review panel. Additionally, the plans were mathemati-cally rated based on plan indices (critical structure and target doses, conformity, monitor units, normal tissue complication probability, and treatment time) and compared to the human rankings. The treatment plans and the reviewers' rankings varied substantially among the participating centers. The average mean overall rank was 2.4 (1.2-4.0) and 8/10 plans were rated excellent in at least one category by at least one reviewer. The mathematical rankings agreed with the mean overall human rankings in 9/10 cases pointing toward the possibility for sole mathematical plan quality comparison. The final rankings revealed that a plan with a well-balanced trade-off among all planning objectives was preferred for treatment by most par-ticipants, reviewers, and the mathematical ranking system. Furthermore, this plan was generated with simple planning techniques. Our multi-institutional planning study found wide variability in ITP approaches for spinal robotic radiosurgery. The participants', reviewers', and mathematical match on preferable treatment plans and ITP techniques indicate that agreement on treatment planning and plan quality can be reached for spinal robotic radiosurgery.

Dataset Information

Attention Based Visual Analysis for Fast Grasp Planning With a Multi-Fingered Robotic Hand.

Publications

Attention Based Visual Analysis for Fast Grasp Planning With a Multi-Fingered Robotic Hand.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets