Prof. Xing-Dong Yang presented his splendid work on “Wearable Interactions Using Touch without a Touchscreen” today at HCIL, University of Maryland, College Park. His pioneering work on MagicFinger (UIST 2012) inspired our work on HandSight. His recent work on Jetto (CHI 2018) extended the design space of micro-finger gestures; Pyro (UIST 2018) extended the haptic potential on smartwatches & smartphones; WrisText extended…
[Talk Summary] HandSight: A Touch-Based Wearable System to Increase Information Accessibility for People with Visual Impairments
My prior collaborator, Lee Stearns, presented his dissertation talk today. HandSight: A Touch-Based Wearable System to Increase Information Accessibility for People with Visual Impairments Please refer to http://www.leestearns.com for more details. An incomplete outline is summarized below: Related Work OrCam, Access Lens, Access Lens, OmniTouch, VizLens (UIST 2016), ForeSee, Google Glass, eSight, NuEyes, IrisVisio Reading / Exploring…
[Talk Summary] A large-scale analysis of YouTube videos depicting everyday thermal camera use
Matt present his Ph.D. defense today. The talk is entitled “A large-scale analysis of YouTube videos depicting everyday thermal camera use”. Both talk and slides are structured of the top quality. Please refer to http://www.cs.umd.edu/~mattm/#pubs for more details about Matt’s slides and papers. Next is a brief outline. Energy audits and thermometric surveying are time…
[Summary] Google I/O and Microsoft Build 2018
Today, two technology festivals were held in Mountain View and Redmond respectively: Google I/O and Microsoft Build 2018. In summary, both companies have all in AI. Google published email auto-completion, photo auto-spot, auto-colorization, better sound synthesis, memorable Q&A, Android P, text from images, style match. Microsoft presented its Fluent Design, Azure AI-enabled edge devices (phone,…
[Summary] StackGAN: Text to Photo-realistic Image Synthesis
StackGAN has got nearly 200 citations since first appeared on arXiv on December 10, 2016. The StackGAN is the first to generate 256*256 image with photo-realistic details from text description. Generative Adversarial Network (GAN), originally proposed by Ian. It takes advantage of a generator network and a discriminator. The generator is trained to fool…
[Summary] Omnipresence 3D for Multiview Mixed Reality
Christian Laforte leads the development of Fortem’s Omnipresence 3D software. It helps organizations prevent costly mistakes and respond to incidents in record time — protecting our communities against increasingly complex security threats. This is definitely a great leap of my prior work, VideoFields. At the time, I was offered only three surveillance video cameras and would…
[Summary] PointNet, PointNet++, and PU-Net
Shuo Li presented a talk at GVIL weekly seminar: PointNet, PointNet++, and PU-Net PointNet Instead of 3D convolution, PointNet directly consumes point clouds, which well respects the permutation invariance of points in the input. A point cloud is an unordered set of vectors. Each point Pi is a vector of its (x, y, z) coordinate plus extra…
Gradient, Circulation, Laplacian, Divergence, Jacobian, Hessian, and Trace
Here is a summary of all these concepts. Most the concepts are from Wikipedia. A larger figure is shown below: In mathematics, the gradient is a multi-variable generalization of the derivative. While a derivative can be defined on functions of a single variable, for functions of several variables, the gradient takes its place. The gradient…
[Summary] Talk by Dr. Chakareski: Networked Virtual and Augmented Reality: The New Frontier
Jacob Chakareski is an Assistant Professor of Electrical and Computer Engineering at The University of Alabama, where he leads the Laboratory for VR/AR Immersive Communication (LION). His interests span networked virtual and augmented reality systems, UAV-IoT sensing and communication, and rigorous machine learning for stochastic control. Dr. Chakareski received the Adobe Digital Experience Faculty Research…
Estimated Cost of Per Atom Function in Real-time Shaders on the GPU
I have created a grouped list of estimated cost of instructions according to this Chinese reference. This may not be accurate, but is mostly correct from my experience. Some intuitions are: Abs, saturate are free (Why is clamp in GLSL not free? I doubt it) Log, exp, sqrt are almost free! (That’s why Kernel Foveated Rendering…
Slideshow
