Researcher profile

Taewoo Kim

Taewoo Kim contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
10works
0followers
8topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2022arXiv

Event-guided Deblurring of Unknown Exposure Time Videos

Motion deblurring is a highly ill-posed problem due to the loss of motion information in the blur degradation process. Since event cameras can capture apparent motion with a high temporal resolution, several attempts have explored the potential of events for guiding deblurring. These methods generally assume that the exposure time is the same as the reciprocal of the video frame rate. However, this is not true in real situations, and the exposure time might be unknown and dynamically varies depending on the video shooting environment(e.g., illumination condition). In this paper, we address the event-guided motion deblurring assuming dynamically variable unknown exposure time of the frame-based camera. To this end, we first derive a new formulation for event-guided motion deblurring by considering the exposure and readout time in the video frame acquisition process. We then propose a novel end-to-end learning framework for event-guided motion deblurring. In particular, we design a novel Exposure Time-based Event Selection(ETES) module to selectively use event features by estimating the cross-modal correlation between the features from blurred frames and the events. Moreover, we propose a feature fusion module to fuse the selected features from events and blur frames effectively. We conduct extensive experiments on various datasets and demonstrate that our method achieves state-of-the-art performance.

preprint2022arXiv

HairFIT: Pose-Invariant Hairstyle Transfer via Flow-based Hair Alignment and Semantic-Region-Aware Inpainting

Hairstyle transfer is the task of modifying a source hairstyle to a target one. Although recent hairstyle transfer models can reflect the delicate features of hairstyles, they still have two major limitations. First, the existing methods fail to transfer hairstyles when a source and a target image have different poses (e.g., viewing direction or face size), which is prevalent in the real world. Also, the previous models generate unrealistic images when there is a non-trivial amount of regions in the source image occluded by its original hair. When modifying long hair to short hair, shoulders or backgrounds occluded by the long hair need to be inpainted. To address these issues, we propose a novel framework for pose-invariant hairstyle transfer, HairFIT. Our model consists of two stages: 1) flow-based hair alignment and 2) hair synthesis. In the hair alignment stage, we leverage a keypoint-based optical flow estimator to align a target hairstyle with a source pose. Then, we generate a final hairstyle-transferred image in the hair synthesis stage based on Semantic-region-aware Inpainting Mask (SIM) estimator. Our SIM estimator divides the occluded regions in the source image into different semantic regions to reflect their distinct features during the inpainting. To demonstrate the effectiveness of our model, we conduct quantitative and qualitative evaluations using multi-view datasets, K-hairstyle and VoxCeleb. The results indicate that HairFIT achieves a state-of-the-art performance by successfully transferring hairstyles between images of different poses, which has never been achieved before.

preprint2022arXiv

Style Your Hair: Latent Optimization for Pose-Invariant Hairstyle Transfer via Local-Style-Aware Hair Alignment

Editing hairstyle is unique and challenging due to the complexity and delicacy of hairstyle. Although recent approaches significantly improved the hair details, these models often produce undesirable outputs when a pose of a source image is considerably different from that of a target hair image, limiting their real-world applications. HairFIT, a pose-invariant hairstyle transfer model, alleviates this limitation yet still shows unsatisfactory quality in preserving delicate hair textures. To solve these limitations, we propose a high-performing pose-invariant hairstyle transfer model equipped with latent optimization and a newly presented local-style-matching loss. In the StyleGAN2 latent space, we first explore a pose-aligned latent code of a target hair with the detailed textures preserved based on local style matching. Then, our model inpaints the occlusions of the source considering the aligned target hair and blends both images to produce a final output. The experimental results demonstrate that our model has strengths in transferring a hairstyle under larger pose differences and preserving local hairstyle textures.

preprint2021arXiv

Cut-and-Paste Dataset Generation for Balancing Domain Gaps in Object Instance Detection

Training an object instance detector where only a few training object images are available is a challenging task. One solution is a cut-and-paste method that generates a training dataset by cutting object areas out of training images and pasting them onto other background images. A detector trained on a dataset generated with a cut-and-paste method suffers from the conventional domain shift problem, which stems from a discrepancy between the source domain (generated training dataset) and the target domain (real test dataset). Though state-of-the-art domain adaptation methods are able to reduce this gap, it is limited because they do not consider the difference of domain gaps of foreground and background. In this study, we present that the conventional domain gap can be divided into two sub-domain gaps for foreground and background. Then, we show that the original cut-and-paste approach suffers from a new domain gap problem, an unbalanced domain gaps, because it has two separate source domains for foreground and background, unlike the conventional domain shift problem. Then, we introduce an advanced cut-and-paste method to balance the unbalanced domain gaps by diversifying the foreground with GAN (generative adversarial network)-generated seed images and simplifying the background using image processing techniques. Experimental results show that our method is effective for balancing domain gaps and improving the accuracy of object instance detection in a cluttered indoor environment using only a few seed images. Furthermore, we show that balancing domain gaps can improve the detection accuracy of state-of-the-art domain adaptation methods.

preprint2021arXiv

Electrochemical Screening of Contact Layers for Metal Halide Perovskites

Optimizing selective contact layers in photovoltaics is necessary to yield high performing stable devices. However, this has been difficult for perovskites due to their complex interfacial defects that affect carrier concentrations in the active layer as well as charge transfer and recombination at the interface. Using vacuum thermally-evaporated tin oxide as a case study, we highlight electrochemical tests that are simple yet screen device-relevant contact layer properties, making them useful for process development and quality control. Specifically, we show that cyclic voltammetry and potentiostatic chronoamperometry correlate to key performance parameters in completed devices as well as other material/interfacial properties relevant to devices such as shunt pathways and chemical composition. Having fast, reliable, scalable, and actionable probes of electronic properties is increasingly important as halide perovskite photovoltaics approach their theoretical limits and scale to large-area devices.

preprint2021arXiv

Search of Intermediate Mass Black Holes at Low Redshift with Intra-night Variability

We present a sample of intermediate-mass black hole (IMBH) candidates based on the detection of a broad H$α$ emission line and variability, which are selected from the Sloan Digital Sky Survey Data Release 7. By performing spectral decomposition of emission lines as well as visual inspection, we initially identified 131 targets with a broad H$α$ line among a large sample of emission-line galaxies. We further selected 25 IMBH candidates, whose estimated black hole mass (M$_{\rm BH}$) is less than $10^6 \rm M_{\odot}$. To constrain the nature of these candidates, we analyzed X-ray properties and performed an intra-night variability monitoring with optical telescopes. Based on the optical variability analysis, we report a sample of 11 targets with detected intra-night variability as the best IMBH candidates, which are suitable for follow-up observations for accurate M$_{\rm BH}$ determination such as reverberation mapping campaigns.

preprint2020arXiv

C-3PO: Cyclic-Three-Phase Optimization for Human-Robot Motion Retargeting based on Reinforcement Learning

Motion retargeting between heterogeneous polymorphs with different sizes and kinematic configurations requires a comprehensive knowledge of (inverse) kinematics. Moreover, it is non-trivial to provide a kinematic independent general solution. In this study, we developed a cyclic three-phase optimization method based on deep reinforcement learning for human-robot motion retargeting. The motion retargeting learning is performed using refined data in a latent space by the cyclic and filtering paths of our method. In addition, the human-in-the-loop based three-phase approach provides a framework for the improvement of the motion retargeting policy by both quantitative and qualitative manners. Using the proposed C-3PO method, we were successfully able to learn the motion retargeting skill between the human skeleton and motion of the multiple robots such as NAO, Pepper, Baxter and C-3PO.

preprint2020arXiv

Original Research By Young Twinkle Students (ORBYTS): Ephemeris Refinement of Transiting Exoplanets

We report follow-up observations of transiting exoplanets that have either large uncertainties (>10 minutes) in their transit times or have not been observed for over three years. A fully robotic ground-based telescope network, observations from citizen astronomers and data from TESS have been used to study eight planets, refining their ephemeris and orbital data. Such follow-up observations are key for ensuring accurate transit times for upcoming ground and space-based telescopes which may seek to characterise the atmospheres of these planets. We find deviations from the expected transit time for all planets, with transits occurring outside the 1 sigma uncertainties for seven planets. Using the newly acquired observations, we subsequently refine their periods and reduce the current predicted ephemeris uncertainties to 0.28 - 4.01 minutes. A significant portion of this work has been completed by students at two high schools in London as part of the Original Research By Young Twinkle Students (ORBYTS) programme.

preprint2020arXiv

Variability and the size-luminosity relation of the intermediate mass AGN in NGC 4395

We present the variability study of the lowest-luminosity Seyfert 1 galaxy NGC 4395 based on the photometric monitoring campaigns in 2017 and 2018. Using 22 ground-based and space telescopes, we monitored NGC 4395 with a $\sim$5 minute cadence during a period of 10 days and obtained light curves in the UV, V, J, H, and K/Ks bands as well as the H$α$ narrow-band. The RMS variability is $\sim$0.13 mag on \emph{Swift}-UVM2 and V filter light curves, decreasing down to $\sim$0.01 mag on K filter. After correcting for continuum contribution to the H$α$ narrow-band, we measured the time lag of the H$α$ emission line with respect to the V-band continuum as ${55}^{+27}_{-31}$ to ${122}^{+33}_{-67}$ min. in 2017 and ${49}^{+15}_{-14}$ to ${83}^{+13}_{-14}$ min. in 2018, depending on the assumption on the continuum variability amplitude in the H$α$ narrow-band. We obtained no reliable measurements for the continuum-to-continuum lag between UV and V bands and among near-IR bands, due to the large flux uncertainty of UV observations and the limited time baseline. We determined the AGN monochromatic luminosity at 5100Å $λL_λ= \left(5.75\pm0.40\right)\times 10^{39}\,\mathrm{erg\,s^{-1}}$, after subtracting the contribution of the nuclear star cluster. While the optical luminosity of NGC 4395 is two orders of magnitude lower than that of other reverberation-mapped AGNs, NGC 4395 follows the size-luminosity relation, albeit with an offset of 0.48 dex ($\geq$2.5$σ$) from the previous best-fit relation of Bentz et al. (2013).

preprint2019arXiv

The Seoul National University AGN monitoring project. II. BLR size and black hole mass of two AGNs

Active galactic nuclei (AGNs) show a correlation between the size of the broad line region (BLR) and the monochromatic continuum luminosity at 5100 Å, allowing black hole mass estimation based on single-epoch spectra. However, the validity of the correlation is yet to be clearly tested for high-luminosity AGNs. We present the first reverberation-mapping results of the Seoul National University AGN monitoring program (SAMP), which is designed to focus on luminous AGNs for probing the high end of the size-luminosity relation. We report time lag measurements of two AGNs, namely, 2MASS J10261389+5237510 and SDSS J161911.24+501109.2, using the light curves obtained over a $\sim$1000 day period with an average cadence of $\sim$10 and $\sim$20 days, respectively for photometry and spectroscopy monitoring. Based on a cross-correlation analysis and H$β$ line width measurements, we determine the H$β$ lag as $41.8^{+4.9}_{-6.0}$ and $52.6^{+17.6}_{-14.7}$ days in the observed-frame, and black hole mass as $3.65^{+0.49}_{-0.57} \times 10^7 M_{\odot}$ and $23.02^{+7.81}_{-6.56} \times 10^7 M_{\odot}$, respectively for 2MASS J1026 and SDSS J1619.