BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Alberto Rodriguez

Alberto Rodriguez appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
RoboticsComputer Visioncond-mat.dis-nnquant-phcond-mat.quant-gaseess.SYMachine Learningphysics.atom-phSystems and ControlArtificial Intelligenceeess.IV

Catalog footprint

What is connected

20works
11topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2022arXiv

Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertion

We propose a method that actively estimates contact location between a grasped rigid object and its environment and uses this as input to a peg-in-hole insertion policy. An estimation model and an active tactile feedback controller work collaboratively to estimate the external contacts accurately. The controller helps the estimation model get a better estimate by regulating a consistent contact mode. The better estimation makes it easier for the controller to regulate the contact. We then train an object-agnostic insertion policy that learns to use the series of contact estimates to guide the insertion of an unseen peg into a hole. In contrast with previous works that learn a policy directly from tactile signals, since this policy is in contact configuration space, it can be learned directly in simulation. Lastly, we demonstrate and evaluate the active extrinsic contact line estimation and the trained insertion policy together in a real experiment. We show that the proposed method inserts various-shaped test objects with higher success rates and fewer insertion attempts than previous work with end-to-end approaches. See supplementary video and results at https://sites.google.com/view/active-extrinsic-contact.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Manipulation of unknown objects via contact configuration regulation

We present an approach to robotic manipulation of unknown objects through regulation of the object's contact configuration: the location, geometry, and mode of all contacts between the object, robot, and environment. A contact configuration constrains the forces and motions that can be applied to the object; however, synthesizing these constraints generally requires knowledge of the object's pose and geometry. We develop an object-agnostic approach for estimation and control that circumvents this need. Our framework directly estimates a set of wrench and motion constraints which it uses to regulate the contact configuration. We use this to reactively manipulate unknown planar objects in the gravity plane. A video describing our work can be found on our project page: http://mcube.mit.edu/research/contactConfig.html.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo techniques. While traditional pipelines struggle with objects like these, Neural Radiance Fields (NeRFs) have recently been shown to be remarkably effective for performing view synthesis on objects with thin structures or reflective materials. In this paper we explore the use of NeRF as a new source of supervision for robust robot vision systems. In particular, we demonstrate that a NeRF representation of a scene can be used to train dense object descriptors. We use an optimized NeRF to extract dense correspondences between multiple views of an object, and then use these correspondences as training data for learning a view-invariant representation of the object. NeRF's usage of a density field allows us to reformulate the correspondence problem with a novel distribution-of-depths formulation, as opposed to the conventional approach of using a depth map. Dense correspondence models supervised with our method significantly outperform off-the-shelf learned descriptors by 106% (PCK@3px metric, more than doubling performance) and outperform our baseline supervised with multi-view stereo by 29%. Furthermore, we demonstrate the learned dense descriptors enable robots to perform accurate 6-degree of freedom (6-DoF) pick and place of thin and reflective objects.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Accurate Vision-based Manipulation through Contact Reasoning

Planning contact interactions is one of the core challenges of many robotic tasks. Optimizing contact locations while taking dynamics into account is computationally costly and, in environments that are only partially observable, executing contact-based tasks often suffers from low accuracy. We present an approach that addresses these two challenges for the problem of vision-based manipulation. First, we propose to disentangle contact from motion optimization. Thereby, we improve planning efficiency by focusing computation on promising contact locations. Second, we use a hybrid approach for perception and state estimation that combines neural networks with a physically meaningful state representation. In simulation and real-world experiments on the task of planar pushing, we show that our method is more efficient and achieves a higher manipulation accuracy than previous vision-based approaches.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Cable Manipulation with a Tactile-Reactive Gripper

Cables are complex, high dimensional, and dynamic objects. Standard approaches to manipulate them often rely on conservative strategies that involve long series of very slow and incremental deformations, or various mechanical fixtures such as clamps, pins or rings. We are interested in manipulating freely moving cables, in real time, with a pair of robotic grippers, and with no added mechanical constraints. The main contribution of this paper is a perception and control framework that moves in that direction, and uses real-time tactile feedback to accomplish the task of following a dangling cable. The approach relies on a vision-based tactile sensor, GelSight, that estimates the pose of the cable in the grip, and the friction forces during cable sliding. We achieve the behavior by combining two tactile-based controllers: 1) Cable grip controller, where a PD controller combined with a leaky integrator regulates the gripping force to maintain the frictional sliding forces close to a suitable value; and 2) Cable pose controller, where an LQR controller based on a learned linear model of the cable sliding dynamics keeps the cable centered and aligned on the fingertips to prevent the cable from falling from the grip. This behavior is possible by a reactive gripper fitted with GelSight-based high-resolution tactile sensors. The robot can follow one meter of cable in random configurations within 2-3 hand regrasps, adapting to cables of different materials and thicknesses. We demonstrate a robot grasping a headphone cable, sliding the fingers to the jack connector, and inserting it. To the best of our knowledge, this is the first implementation of real-time cable following without the aid of mechanical fixtures.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Hybrid Differential Dynamic Programming for Planar Manipulation Primitives

We present a hybrid differential dynamic programming (DDP) algorithm for closed-loop execution of manipulation primitives with frictional contact switches. Planning and control of these primitives is challenging as they are hybrid, under-actuated, and stochastic. We address this by developing hybrid DDP both to plan finite horizon trajectories with a few contact switches and to create linear stabilizing controllers. We evaluate the performance and computational cost of our framework in ablations studies for two primitives: planar pushing and planar pivoting. We find that generating pose-to-pose closed-loop trajectories from most configurations requires only a couple (one to two) hybrid switches and can be done in reasonable time (one to five seconds). We further demonstrate that our controller stabilizes these hybrid trajectories on a real pushing system. A video describing our work can be found at https://youtu.be/YGSe4cUfq6Q.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Long-Horizon Prediction and Uncertainty Propagation with Residual Point Contact Learners

The ability to simulate and predict the outcome of contacts is paramount to the successful execution of many robotic tasks. Simulators are powerful tools for the design of robots and their behaviors, yet the discrepancy between their predictions and observed data limit their usability. In this paper, we propose a self-supervised approach to learning residual models for rigid-body simulators that exploits corrections of contact models to refine predictive performance and propagate uncertainty. We empirically evaluate the framework by predicting the outcomes of planar dice rolls and compare it's performance to state-of-the-art techniques.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Robotic Pick-and-Place of Novel Objects in Clutter with Multi-Affordance Grasping and Cross-Domain Image Matching

This paper presents a robotic pick-and-place system that is capable of grasping and recognizing both known and novel objects in cluttered environments. The key new feature of the system is that it handles a wide range of object categories without needing any task-specific training data for novel objects. To achieve this, it first uses a category-agnostic affordance prediction algorithm to select and execute among four different grasping primitive behaviors. It then recognizes picked objects with a cross-domain image classification framework that matches observed images to product images. Since product images are readily available for a wide range of objects (e.g., from the web), the system works out-of-the-box for novel objects without requiring any additional training data. Exhaustive experimental results demonstrate that our multi-affordance grasping achieves high success rates for a wide variety of objects in clutter, and our recognition algorithm achieves high accuracy for both known and novel grasped objects. The approach was part of the MIT-Princeton Team system that took 1st place in the stowing task at the 2017 Amazon Robotics Challenge. All code, datasets, and pre-trained models are available online at http://arc.cs.princeton.edu

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Tactile Dexterity: Manipulation Primitives with Tactile Feedback

This paper develops closed-loop tactile controllers for dexterous robotic manipulation with a dual-palm robotic system. Tactile dexterity is an approach to dexterous manipulation that plans for robot/object interactions that render interpretable tactile information for control. We divide the role of tactile control into two goals: 1) control the contact state between the end-effector and the object (contact/no-contact, stick/slip) by regulating the stability of planned contact configurations and monitoring undesired slip events; and 2) control the object state by tactile-based tracking and iterative replanning of the object and robot trajectories. Key to this formulation is the decomposition of manipulation plans into sequences of manipulation primitives with simple mechanics and efficient planners. We consider the scenario of manipulating an object from an initial pose to a target pose on a flat surface while correcting for external perturbations and uncertainty in the initial pose of the object. We experimentally validate the approach with an ABB YuMi dual-arm robot and demonstrate the ability of the tactile controller to react to external perturbations.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

TossingBot: Learning to Throw Arbitrary Objects with Residual Physics

We investigate whether a robot arm can learn to pick and throw arbitrary objects into selected boxes quickly and accurately. Throwing has the potential to increase the physical reachability and picking speed of a robot arm. However, precisely throwing arbitrary objects in unstructured settings presents many challenges: from acquiring reliable pre-throw conditions (e.g. initial pose of object in manipulator) to handling varying object-centric properties (e.g. mass distribution, friction, shape) and dynamics (e.g. aerodynamics). In this work, we propose an end-to-end formulation that jointly learns to infer control parameters for grasping and throwing motion primitives from visual observations (images of arbitrary objects in a bin) through trial and error. Within this formulation, we investigate the synergies between grasping and throwing (i.e., learning grasps that enable more accurate throws) and between simulation and deep learning (i.e., using deep networks to predict residuals on top of control parameters predicted by a physics simulator). The resulting system, TossingBot, is able to grasp and throw arbitrary objects into boxes located outside its maximum reach range at 500+ mean picks per hour (600+ grasps per hour with 85% throwing accuracy); and generalizes to new objects and target locations. Videos are available at https://tossingbot.cs.princeton.edu

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A Summary of Team MIT's Approach to the Amazon Picking Challenge 2015

The Amazon Picking Challenge (APC), held alongside the International Conference on Robotics and Automation in May 2015 in Seattle, challenged roboticists from academia and industry to demonstrate fully automated solutions to the problem of picking objects from shelves in a warehouse fulfillment scenario. Packing density, object variability, speed, and reliability are the main complexities of the task. The picking challenge serves both as a motivation and an instrument to focus research efforts on a specific manipulation problem. In this document, we describe Team MIT's approach to the competition, including design considerations, contributions, and performance, and we compile the lessons learned. We also describe what we think are the main remaining challenges.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Feedback Control of the Pusher-Slider System: A Story of Hybrid and Underactuated Contact Dynamics

This paper investigates real-time control strategies for dynamical systems that involve frictional contact interactions. Hybridness and underactuation are key characteristics of these systems that complicate the design of feedback controllers. In this research, we examine and test a novel feedback controller design on a planar pushing system, where the purpose is to control the motion of a sliding object on a flat surface using a point robotic pusher. The pusher-slider is a simple dynamical system that retains many of the challenges that are typical of robotic manipulation tasks. Our results show that a model predictive control approach used in tandem with integer programming offers a powerful solution to capture the dynamic constraints associated with the friction cone as well as the hybrid nature of the contact. In order to achieve real-time control, simplifications are proposed to speed up the integer program. The concept of Family of Modes (FOM) is introduced to solve an online convex optimization problem by selecting a set of contact mode schedules that spans a large set of dynamic behaviors that can occur during the prediction horizon. The controller design is applied to stabilize the motion of a sliding object about a nominal trajectory, and to re-plan its trajectory in real-time to follow a moving target. We validate the controller design through numerical simulations and experimental results on an industrial ABB IRB 120 robotic arm.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

More than a Million Ways to Be Pushed: A High-Fidelity Experimental Dataset of Planar Pushing

Pushing is a motion primitive useful to handle objects that are too large, too heavy, or too cluttered to be grasped. It is at the core of much of robotic manipulation, in particular when physical interaction is involved. It seems reasonable then to wish for robots to understand how pushed objects move. In reality, however, robots often rely on approximations which yield models that are computable, but also restricted and inaccurate. Just how close are those models? How reasonable are the assumptions they are based on? To help answer these questions, and to get a better experimental understanding of pushing, we present a comprehensive and high-fidelity dataset of planar pushing experiments. The dataset contains timestamped poses of a circular pusher and a pushed object, as well as forces at the interaction.We vary the push interaction in 6 dimensions: surface material, shape of the pushed object, contact position, pushing direction, pushing speed, and pushing acceleration. An industrial robot automates the data capturing along precisely controlled position-velocity-acceleration trajectories of the pusher, which give dense samples of positions and forces of uniform quality. We finish the paper by characterizing the variability of friction, and evaluating the most common assumptions and simplifications made by models of frictional pushing in robotics.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Matter-wave scattering from strongly interacting bosons in an optical lattice

We study the scattering of a matter-wave from an interacting system of bosons in an optical lattice, focusing on the strong-interaction regime. Analytical expressions for the many-body scattering cross section are derived from a strong-coupling expansion and a site-decoupling mean-field approximation, and compared to numerically obtained exact results. In the thermodynamic limit, we find a non-vanishing inelastic cross section throughout the Mott insulating regime, which decays quadratically as a function of the boson-boson interaction.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Extracting partial decay rates of helium from complex rotation: autoionizing resonances of the one-dimensional configurations

Partial autoionization rates of doubly excited one-dimensional helium in the collinear Zee and eZe configuration are obtained by means of the complex rotation method. The approach presented here relies on a projection of back-rotated resonance wave functions onto singly ionized $\textrm{He}^{+}$ channel wave functions and the computation of the corresponding particle fluxes. In spite of the long-range nature of the Coulomb potential between the electrons and the nucleus, an asymptotic region where the fluxes are stationary is clearly observed. Low-lying doubly excited states are found to decay predomintantly into the nearest single-ionization continuum. This approach paves the way for a systematic analysis of the decay rates observed in higher-dimensional models, and of the role of electronic correlations and atomic structure in recent photoionization experiments.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Interaction effects on dynamical localization in driven helium

Dynamical localization prevents driven atomic systems from fast fragmentation by hampering the excitation process. We present numerical simulations within a collinear model of microwave-driven helium Rydberg atoms and prove that dynamical localization survives the impact of electron-electron interaction, even for doubly excited states in the presence of fast autoionization. We conclude that the effect of electron-electron repulsion on localization can be described by an appropriate rescaling of the atomic level density and of the external field with the strength of the interaction.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Matter-wave scattering from interacting bosons in an optical lattice

We study the scattering of matter-waves from interacting bosons in a one-dimensional optical lattice, described by the Bose-Hubbard Hamiltonian. We derive analytically a formula for the inelastic cross section as a function of the atomic interaction in the lattice, employing Bogoliubov's formalism for small condensate depletion. A linear decay of the inelastic cross section for weak interaction, independent of number of particles, condensate depletion and system size, is found.

0 citations0 reviewsNo code linkedOpen access
preprint2012arXiv

Controlled engineering of extended states in disordered systems

We describe how to engineer wavefunction delocalization in disordered systems modelled by tight-binding Hamiltonians in d>1 dimensions. We show analytically that a simple product structure for the random onsite potential energies, together with suitably chosen hopping strengths, allows a resonant scattering process leading to ballistic transport along one direction, and a controlled coexistence of extended Bloch states and anisotropically localized states in the spectrum. We demonstrate that these features persist in the thermodynamic limit for a continuous range of the system parameters. Numerical results support these findings and highlight the robustness of the extended regime with respect to deviations from the exact resonance condition for finite systems. The localization and transport properties of the system can be engineered almost at will and independently in each direction. This study gives rise to the possibility of designing disordered potentials that work as switching devices and band-pass filters for quantum waves, such as matter waves in optical lattices.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Multifractal finite-size-scaling and universality at the Anderson transition

We describe a new multifractal finite size scaling (MFSS) procedure and its application to the Anderson localization-delocalization transition. MFSS permits the simultaneous estimation of the critical parameters and the multifractal exponents. Simulations of system sizes up to L^3=120^3 and involving nearly 10^6 independent wavefunctions have yielded unprecedented precision for the critical disorder W_c=16.530 (16.524,16.536) and the critical exponent nu=1.590 (1.579,1.602). We find that the multifractal exponents Delta_q exhibit a previously predicted symmetry relation and we confirm the non-parabolic nature of their spectrum. We explain in detail the MFSS procedure first introduced in our Letter [Phys. Rev. Lett. 105, 046403 (2010)] and, in addition, we show how to take account of correlations in the simulation data. The MFSS procedure is applicable to any continuous phase transition exhibiting multifractal fluctuations in the vicinity of the critical point.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

Critical parameters from generalised multifractal analysis at the Anderson transition

We propose a generalization of multifractal analysis that is applicable to the critical regime of the Anderson localization-delocalization transition. The approach reveals that the behavior of the probability distribution of wavefunction amplitudes is sufficient to characterize the transition. In combination with finite-size scaling, this formalism permits the critical parameters to be estimated without the need for conductance or other transport measurements. Applying this method to high-precision data for wavefunction statistics obtained by exact diagonalization of the three-dimensional Anderson model, we estimate the critical exponent $ν=1.58\pm 0.03$.

0 citations0 reviewsNo code linkedOpen access