Source author record

Jun Saito

Jun Saito appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

12works
7topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

12 published item(s)

preprint2022arXiv

FaceFormer: Speech-Driven 3D Facial Animation with Transformers

Speech-driven 3D facial animation is challenging due to the complex geometry of human faces and the limited availability of 3D audio-visual data. Prior works typically focus on learning phoneme-level features of short audio windows with limited context, occasionally resulting in inaccurate lip movements. To tackle this limitation, we propose a Transformer-based autoregressive model, FaceFormer, which encodes the long-term audio context and autoregressively predicts a sequence of animated 3D face meshes. To cope with the data scarcity issue, we integrate the self-supervised pre-trained speech representations. Also, we devise two biased attention mechanisms well suited to this specific task, including the biased cross-modal multi-head (MH) attention and the biased causal MH self-attention with a periodic positional encoding strategy. The former effectively aligns the audio-motion modalities, whereas the latter offers abilities to generalize to longer audio sequences. Extensive experiments and a perceptual user study show that our approach outperforms the existing state-of-the-arts. The code will be made available.

preprint2022arXiv

Neural Jacobian Fields: Learning Intrinsic Mappings of Arbitrary Meshes

This paper introduces a framework designed to accurately predict piecewise linear mappings of arbitrary meshes via a neural network, enabling training and evaluating over heterogeneous collections of meshes that do not share a triangulation, as well as producing highly detail-preserving maps whose accuracy exceeds current state of the art. The framework is based on reducing the neural aspect to a prediction of a matrix for a single given point, conditioned on a global shape descriptor. The field of matrices is then projected onto the tangent bundle of the given mesh, and used as candidate jacobians for the predicted map. The map is computed by a standard Poisson solve, implemented as a differentiable layer with cached pre-factorization for efficient training. This construction is agnostic to the triangulation of the input, thereby enabling applications on datasets with varying triangulations. At the same time, by operating in the intrinsic gradient domain of each individual mesh, it allows the framework to predict highly-accurate mappings. We validate these properties by conducting experiments over a broad range of scenarios, from semantic ones such as morphing, registration, and deformation transfer, to optimization-based ones, such as emulating elastic deformations and contact correction, as well as being the first work, to our knowledge, to tackle the task of learning to compute UV parameterizations of arbitrary meshes. The results exhibit the high accuracy of the method as well as its versatility, as it is readily applied to the above scenarios without any changes to the framework.

preprint2022arXiv

Skeleton-free Pose Transfer for Stylized 3D Characters

We present the first method that automatically transfers poses between stylized 3D characters without skeletal rigging. In contrast to previous attempts to learn pose transformations on fixed or topology-equivalent skeleton templates, our method focuses on a novel scenario to handle skeleton-free characters with diverse shapes, topologies, and mesh connectivities. The key idea of our method is to represent the characters in a unified articulation model so that the pose can be transferred through the correspondent parts. To achieve this, we propose a novel pose transfer network that predicts the character skinning weights and deformation transformations jointly to articulate the target character to match the desired pose. Our method is trained in a semi-supervised manner absorbing all existing character data with paired/unpaired poses and stylized shapes. It generalizes well to unseen stylized characters and inanimate objects. We conduct extensive experiments and demonstrate the effectiveness of our method on this novel task.

preprint2019arXiv

Minimally Supervised Learning of Affective Events Using Discourse Relations

Recognizing affective events that trigger positive or negative sentiment has a wide range of natural language processing applications but remains a challenging problem mainly because the polarity of an event is not necessarily predictable from its constituent words. In this paper, we propose to propagate affective polarity using discourse relations. Our method is simple and only requires a very small seed lexicon and a large raw corpus. Our experiments using Japanese data show that our method learns affective events effectively without manually labeled data. It also improves supervised learning results when labeled data are small.

preprint2015arXiv

Summary of Super Doubler Approach on Exact Lattice Supersymmetry

We have proposed a lattice SUSY formulation which we may call super doubler approach, where chiral fermion species doublers and their bosonic counter parts are either identified as super partners or truncated by chiral conditions. We claim that the super symmetry is exactly kept on the lattice. However the formulation is nonlocal and breaks lattice translational invariance. We argue that these features cause no fundamental difficulties in the continuum limit. Although a naive version of this formulation breaks associativity of the product of fields we have found a modified super doubler approach that recovers the associativity and is applicable to super Yang-Mills theory. It turns out that this formulation is essentially equivalent to the continuum formulation and thus keeps all the symmetry exact even at a finite lattice constant. Inspired by this formulation we propose a non-local lattice field theory formulation which is free of chiral fermion problem and has the same exact lattice symmetry as continuum theory.

preprint2012arXiv

Species Doublers as Super Multiplets in Lattice Supersymmetry: Chiral Conditions of Wess-Zumino Model for D=N=2

We propose an algebraic lattice supersymmetry formulation which has an exact supersymmetry on the lattice. We show how lattice version of chiral conditions can be imposed to satisfy an exact lattice supersymmetry algebra. The species doublers of chiral fermions and the corresponding bosonic counterparts can be accommodated to fit into chiral supermultiplets of lattice supersymmetry and thus lattice chiral fermion problem does not appear. We explicitly show how N=2 Wess-Zumino model in one and two dimensions can be formulated to keep exact supersymmetry for all super charges on the lattice. The momentum representation of N=2 lattice chiral sypersymmetry algebra has lattice periodicity and thus momentum conservation should be modified to a lattice version of sine momentum conservation, which generates nonlocal interactions and leads to a loss of lattice translational invariance. It is shown that the nonlocality is mild and the translational invariance is recovered in the continuum limit. In the coordinate representation a new type of product is defined and the difference operator satisfies Leibnitz rule and an exact lattice supersymmetry is realized on this product.

preprint2010arXiv

Species Doublers as Super Multiplet Partners in Lattice Supersymmetry

We propose a new lattice superfield formalism in momentum representation which accommodates species doublers of the lattice fermions and their bosonic counterparts as super multiplets. We explicitly show that one dimensional $N=2$ model with interactions has exact supersymmetry on the lattice for all super charges with lattice momentum. In coordinate representation the finite difference operator is made to satisfy Leibnitz rule by introducing a non local product, the "star" product, and the exact lattice supersymmetry is realized. Supersymmetric Ward identities are shown to be satisfied at one loop level.

preprint2010arXiv

Species Doublers as Super Multiplets in Lattice Supersymmetry: Exact Supersymmetry with Interactions for D=1 N=2

We propose a new lattice superfield formalism in momentum representation which accommodates species doublers of the lattice fermions and their bosonic counterparts as super multiplets. We explicitly show that one dimensional N=2 model with interactions has exact Lie algebraic supersymmetry on the lattice for all super charges. In coordinate representation the finite difference operator is made to satisfy Leibnitz rule by introducing a non local product, the ``star'' product, and the exact lattice supersymmetry is realized. The standard momentum conservation is replaced on the lattice by the conservation of the sine of the momentum, which plays a crucial role in the formulation. Half lattice spacing structure is essential for the one dimensional model and the lattice supersymmetry transformation can be identified as a half lattice spacing translation combined with alternating sign structure. Invariance under finite translations and locality in the continuum limit are explicitly investigated and shown to be recovered. Supersymmetric Ward identities are shown to be satisfied at one loop level. Lie algebraic lattice supersymmetry algebra of this model suggests a close connection with Hopf algebraic exactness of the link approach formulation of lattice supersymmetry.

preprint2009arXiv

Formulation of Supersymmetry on a Lattice as a Representation of a Deformed Superalgebra

The lattice superalgebra of the link approach is shown to satisfy a Hopf algebraic supersymmetry where the difference operator is introduced as a momentum operator. The breakdown of the Leibniz rule for the lattice difference operator is accommodated as a coproduct operation of (quasi)triangular Hopf algebra and the associated field theory is consistently defined as a braided quantum field theory. Algebraic formulation of path integral is perturbatively defined and Ward-Takahashi identity can be derived on the lattice. The claimed inconsistency of the link approach leading to the ordering ambiguity for a product of fields is solved by introducing an almost trivial braiding structure corresponding to the triangular structure of the Hopf algebraic superalgebra. This could be seen as a generalization of spin and statistics relation on the lattice. From the consistency of this braiding structure of fields a grading nature for the momentum operator is required.

preprint2009arXiv

Lattice supersymmetry with Hopf algebra for the link approach

A formalism of lattice supersymmetry based on a lattice-deformed superalgebra which was originally introduced in the link approach formulation is presented. We propose that the superalgebra can in fact be identified as a Hopf algebra, showing all the Hopf algebra axioms and consistencies are satisfied with explicit formulae. In particular, the "deformed" Leibniz rules proposed in the original link approach are now built in the coproduct structure of the Hopf algebra. Fields in this scheme, as representations of the Hopf algebra, are found to obey a kind of mildly deformed statistics, which is interpreted as a braiding strucutre. We can then construct, at least perturbatively, the corresponding lattice field theory, which has the Hopf algebraic symmetry with the deformed statistics, as an example of braided quantumm field theory formulated by Oeckl.

preprint2009arXiv

Lattice Supersymmetry: Some Ideas from Low Dimensional Models

In the framework of the so called link approach we study exact lattice supersymmetry for the simplest supersymmetric model: N=1 supersymmetry in D=1. The model is described by a lattice with spacing a/2, thus containing twice as many sites as the conventional one. The boson and fermion are related through a 2pi/a momentum shift, which can provide an interpretation of them being species doublers to each other. An exactly supersymmetric lattice action can be written within this scheme in momentum representation, which however turns out to be non local in coordinate space.

preprint2009arXiv

The Hayabusa Spacecraft Asteroid Multi-Band Imaging Camera: AMICA

The Hayabusa Spacecraft Asteroid Multiband Imaging Camera (AMICA) has acquired more than 1400 multispectral and high-resolution images of its target asteroid, 25143 Itokawa, since late August 2005. In this paper, we summarize the design and performance of AMICA. In addition, we describe the calibration methods, assumptions, and models, based on measurements. Major calibration steps include corrections for linearity and modeling and subtraction of bias, dark current, read-out smear, and pixel-to-pixel responsivity variations. AMICA v-band data were calibrated to radiance using in-flight stellar observations. The other band data were calibrated to reflectance by comparing them to ground-based observations to avoid the uncertainty of the solar irradiation in those bands. We found that the AMICA signal was linear with respect to the input signal to an accuracy of << 1% when the signal level was < 3800 DN. We verified that the absolute radiance calibration of the AMICA v-band (0.55 micron) was accurate to 4% or less, the accuracy of the disk-integrated spectra with respect to the AMICA v-band was about 1%, and the pixel-to-pixel responsivity (flatfield) variation was 3% or less. The uncertainty in background zero-level was 5 DN. From wide-band observations of star clusters, we found that the AMICA optics have an effective focal length of 120.80 \pm 0.03 mm, yielding a field-of-view (FOV) of 5.83 deg x 5.69 deg. The resulting geometric distortion model was accurate to within a third of a pixel. We demonstrated an image-restoration technique using the point-spread functions of stars, and confirmed that the technique functions well in all loss-less images. An artifact not corrected by this calibration is scattered light associated with bright disks in the FOV.