BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Jun Morimoto

Jun Morimoto appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Machine LearningRoboticsArtificial Intelligenceeess.SYmath.DSNeurons and Cognitionphysics.soc-phSystems and Control

Catalog footprint

What is connected

7works
8topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

7 published item(s)

preprint2022arXiv

Randomized-to-Canonical Model Predictive Control for Real-world Visual Robotic Manipulation

Many works have recently explored Sim-to-real transferable visual model predictive control (MPC). However, such works are limited to one-shot transfer, where real-world data must be collected once to perform the sim-to-real transfer, which remains a significant human effort in transferring the models learned in simulations to new domains in the real world. To alleviate this problem, we first propose a novel model-learning framework called Kalman Randomized-to-Canonical Model (KRC-model). This framework is capable of extracting task-relevant intrinsic features and their dynamics from randomized images. We then propose Kalman Randomized-to-Canonical Model Predictive Control (KRC-MPC) as a zero-shot sim-to-real transferable visual MPC using KRC-model. The effectiveness of our method is evaluated through a valve rotation task by a robot hand in both simulation and the real world, and a block mating task in simulation. The experimental results show that KRC-MPC can be applied to various real domains and tasks in a zero-shot manner.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Two are not always better than one: Role specialization is an important determinant of collaborative task performance

Collaboration frequently yields better results in decision making, learning, and haptic interactions than when these actions are performed individually. However, is collaboration always superior to solo actions, or do its benefits depend on whether collaborating individuals have different or the same roles? To answer this question, we asked human subjects to perform virtual-reality collaborative and individual beam transportation tasks. These tasks were simulated in real-time by coupling the motion of a pair of hand-held robotic manipulanda to the virtual beam using virtual spring-dampers. For the task to be considered successful, participants had to complete it within temporal and spatial constraints. While the visual feedback remained the same, the underlying dynamics of the beam were altered to create two distinctive task contexts which were determined by a moving pivot constraint. When the pivot was placed at the center of the beam, two hands contribute to the task with symmetric mechanical leverage (symmetric context). When the pivot was placed at the left side of the beam, two hands contribute to the task with asymmetric mechanical leverage (asymmetric context). Participants performed these task contexts either individually with both hands (solo), or collaboratively by pairing one hand with another one (dyads). We found that dyads in the asymmetric context performed better than solos. In contrast, solos performed the symmetric context better than dyads. Importantly, we found that two hands took different roles in the asymmetric context for both solos and dyads. In contrast, the contribution from each hand was statistically indistinguishable in the symmetric context. Our findings suggest that better performance in dyads than solos is not a general phenomenon, but rather that collaboration yields better performance only when role specialization emerges in dyadic interactions.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Phase Portraits as Movement Primitives for Fast Humanoid Robot Control

Currently, usual approaches for fast robot control are largely reliant on solving online optimal control problems. Such methods are known to be computationally intensive and sensitive to model accuracy. On the other hand, animals plan complex motor actions not only fast but seemingly with little effort even on unseen tasks. This natural sense to infer temporal dynamics and coordination motivates us to approach robot control from a motor skill learning perspective to design fast and computationally light controllers that can be learned autonomously by the robot under mild modeling assumptions. This article introduces Phase Portrait Movement Primitives (PPMP), a primitive that predicts dynamics on a low dimensional phase space which in turn is used to govern the high dimensional kinematics of the task. The stark difference with other primitive formulations is a built-in mechanism for phase prediction in the form of coupled oscillators that replaces model-based state estimators such as Kalman filters. The policy is trained by optimizing the parameters of the oscillators whose output is connected to a kinematic distribution in the form of a phase portrait. The drastic reduction in dimensionality allows us to efficiently train and execute PPMPs on a real human-sized, dual-arm humanoid upper body on a task involving 20 degrees-of-freedom. We demonstrate PPMPs in interactions requiring fast reactions times while generating anticipative pose adaptation in both discrete and cyclic tasks.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Balancer effects in opinion dynamics

We introduce a novel type of contrarian agent, the balancer, to Galam model of opinion dynamics, in order to account for the existence of social skepticism over one-sidedness. We find that the inclusion of balancers, along with majoritarian floaters and single-sided inflexibles, brings about the emergence of a critical point on parametric plane of the dynamical system. Around the critical point, three distinct phases of opinion dynamics separated by discontinuous changes are found.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Efficient Reuse of Previous Experiences to Improve Policies in Real Environment

In this study, we show that a movement policy can be improved efficiently using the previous experiences of a real robot. Reinforcement Learning (RL) is becoming a popular approach to acquire a nonlinear optimal policy through trial and error. However, it is considered very difficult to apply RL to real robot control since it usually requires many learning trials. Such trials cannot be executed in real environments because unrealistic time is necessary and the real system's durability is limited. Therefore, in this study, instead of executing many learning trials, we propose to use a recently developed RL algorithm, importance-weighted PGPE, by which the robot can efficiently reuse previously sampled data to improve it's policy parameters. We apply importance-weighted PGPE to CB-i, our real humanoid robot, and show that it can learn a target reaching movement and a cart-pole swing up movement in a real environment without using any prior knowledge of the task or any carefully designed initial trajectory.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Efficient Sample Reuse in Policy Gradients with Parameter-based Exploration

The policy gradient approach is a flexible and powerful reinforcement learning method particularly for problems with continuous actions such as robot control. A common challenge in this scenario is how to reduce the variance of policy gradient estimates for reliable policy updates. In this paper, we combine the following three ideas and give a highly effective policy gradient method: (a) the policy gradients with parameter based exploration, which is a recently proposed policy search method with low variance of gradient estimates, (b) an importance sampling technique, which allows us to reuse previously gathered data in a consistent way, and (c) an optimal baseline, which minimizes the variance of gradient estimates with their unbiasedness being maintained. For the proposed method, we give theoretical analysis of the variance of gradient estimates and show its usefulness through extensive experiments.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Model-Based Policy Gradients with Parameter-Based Exploration by Least-Squares Conditional Density Estimation

The goal of reinforcement learning (RL) is to let an agent learn an optimal control policy in an unknown environment so that future expected rewards are maximized. The model-free RL approach directly learns the policy based on data samples. Although using many samples tends to improve the accuracy of policy learning, collecting a large number of samples is often expensive in practice. On the other hand, the model-based RL approach first estimates the transition model of the environment and then learns the policy based on the estimated transition model. Thus, if the transition model is accurately learned from a small amount of data, the model-based approach can perform better than the model-free approach. In this paper, we propose a novel model-based RL method by combining a recently proposed model-free policy search method called policy gradients with parameter-based exploration and the state-of-the-art transition model estimator called least-squares conditional density estimation. Through experiments, we demonstrate the practical usefulness of the proposed method.

0 citations0 reviewsNo code linkedOpen access