Matt present his Ph.D. defense today. The talk is entitled “A large-scale analysis of YouTube videos depicting everyday thermal camera use”.

Both talk and slides are structured of the top quality. Please refer to http://www.cs.umd.edu/~mattm/#pubs for more details about Matt’s slides and papers.

Next is a brief outline.

 


Energy audits and thermometric surveying are time and labor intensive.

  • Missing insulation
  • Air leakage
  • Moisture Intrusion

Solutions:

  • Sealing air leaks
  • Adding insulation
  • Improving lighting
  • Increasing efficiency of appliances

 

Research Thread I: YouTube Study 

  • Dataset Generation
    • Keywords, search and expand keywords, filter and validate data, compile full dataset
  • SMIDGen
    • first 200 results, KLD (Kullback-Leibler Divergence and word occurrence)
    • infrared, lepton, thermal, flir, 
  • Qualitative Coding
    • Informal exploration
    • Outdoor recreation
    • Small Electronics
    • Vehicles
    • Emergency Applications
    • Health and Wellness
    • Research
  • Can I thermal camera see through water?
  • What types of misconception of thermal cameras?
  • “Insulation does not cover all the way to the corner of the house.”
  • 7.7% response rate
  • 72% use thermal cameras to perform DIY
  • 86% users audit single-family residential homes
  • 17% just being curious
  • 6% claims against landlords or contractors
  • 60% reported investing in renovations or retrofits
  • fewer engaged in concentration behaviors
  • Research outcomes
    • Characterization of common thermal camera use
  • Novice Smartphone Field Study
  • Professional Thermography Study
  • Temporal Thermography Study I
  • Temporal Thermography Study II
  • Conclusion and Future Work

Study Design

  • Pre-Study questionnaire
  • Introduction Meeting in local cafe
  • Hardware/Software Overview
  • 4 Page Thermogrpahic Inspection Guide
  • Mission: Investigate your home with your thermal camera for signs 
  • Survey: Weekly Questionnaire
  • Semi-Structured Interview
    • “It was pretty clear to me …”
  • Post-study questionnaire
  • We qualitatively coded the survey, interview, …

Thermography

  • Home
    • 572 photos, AVG = 57.2, SD = 52.27
  • Workplace
    • 405 photos, AVG 49.5, SD-18.02
    • Sleep mode: unused for the weekend but still appeared hot
    •  
  • Community

Field activities

  • Indoor
  • Walls
  • Electronics
  • Light Fixtures
  • People/Pets
  • Outdoor
  • w=Windows
  • Doors
  • Ceilings
  • Play/Experiments

Semi-Structured Interviews

  • Knowledge Discovery
  • Potential Benefits
  • All participants considered the thermal camera a valuable investigative tool.
  • Most participants suggested that supporting decisions.
  • I have been meaning to contact my landloard….
  • All participants described capturing imagery that they could comfortably interpret and imagery that they did not understand
  • I don’t know how much it is related to …
  • Locus of Control
    • If I took a picture that showed the issue, … don’t have solution to fix…

How can we scale thermographic assessments?

  • Energy / Auditing Backback
  • Cars Mounted Thermography cameras
  • No human perspective in automated thermogrphy literature

Thread II: UAVs

  • Research Question:
    • How is thermography currently being used by professional…
  • Recruit participants using listserv
  • 10 participants (1 Female)
  • Semi-Structured Interviews
  • Presentation of Design Probes
  • Observational Case Study
  • You are responsible for a small fleet of UAVs. The UAVs fly around semi-autonomously collecting thermal data, enable historical reports showing thermal performance over time
  • Mid-Fi Prototype, 3D reconstruction, anamaly detection, thermal analysis
  • We qualitatively coded the interview
  • Required knowledge
  • Client interactions
  • Challenges
  • Automatic anomaly detection
  • Model generation
  • Automated approaches lack control of environment
  • Data overload: how to manage orders of magnitude more data?
  • Energy auditing is a social process
  • Observational Case Study
  • An assessment of professional energy auditing and thermography’s role therein.
  • A critical examination of emerging automated solutions

Thread III – Easy-to-deploy thermographic sensor kit

  • GPS Unit and high capacity battery
  • Thermal camera
  • Motion sensor
  • The energy auditor used the system to audit Hornbake library.
  • Using the tool is easy if I know what I am going to look at
  • Temporal data may make identifying transient environmental conditions easier to identify
  • Revised visualization
  • Thermal analysis
  • Overnight 1, 2, Full Campaign 
  • Novice Study
    • 5 participants
    • There are some very cold spots in the office, but it’s hard to tell why
    • Interactive reporting
      • 4 of 5 were positive about receiving the easy-to-read, automatically generated report
      • 4 of 5 liked having longitudinal data and the additional depth the report provided by comparison to thermograms alone.
    • data privacy
      • if it were just a local network I use in my house, it’s totally fine
    • personal confidence
      • It has made me more general repairs
    • post-mission attitudes
  • Professional Study
    • Raising Awareness
    • Providing Reliable Data
    • Relationship Building
    • Coverage and Installation
    • Motivating Action
  • Temporal analysis provides more specific insights in the case of insulation performance