Organizing Committee
Abstract

Building systems that can understand visual concepts and describe them coherently in natural language is fundamental to artificial intelligence. Advances in machine learning have had profound impact on computer vision and natural language processing. There has been interesting progress in recent years at the intersection of these two fields, producing systems that describe (eg., caption) images and videos captured by personal cameras in ordinary scenes and street views. Much work remains in this and a host of related problems, including that of building natural language descriptions of commercial overhead imagery and videos, where automation is greatly needed: "If we were to attempt to manually exploit the commercial satellite imagery we expect to have over the next 20 years, we would need eight million imagery analysts" [Robert Cardillo, NGA Director, GEOINT Symposium 2017]. This workshop brings together researchers in machine learning, computer vision, natural language processing to discuss best practices in machine generated descriptions for both consumer and overhead imagery and videos. Participants will identify challenges, and recommend future research topics.

Confirmed Speakers & Participants

  • Speaker
  • Poster Presenter
  • Attendee

Workshop Schedule

Monday, February 25, 2019
TimeEventLocationMaterials
8:30 - 8:55Registration - ICERM 121 South Main Street, Providence RI 0290311th Floor Collaborative Space 
8:55 - 9:00Welcome - ICERM Director11th Floor Lecture Hall 
9:00 - 9:45Data Programming for Imaging Problems - Leveraging Domain Expertise, Auxiliary Modalities, and Multiple Tasks - Jared Dunnmon, Stanford University11th Floor Lecture Hall
10:00 - 10:30Coffee/Tea Break 11th Floor Collaborative Space 
10:30 - 11:15Jointly Generating Image Captions to Aid Visual Question Answering - Raymond Mooney, The University of Texas at Austin11th Floor Lecture Hall
11:30 - 12:15Uncertainty quantification in graph-based classification of high dimensional data - Andrea Bertozzi, UCLA11th Floor Lecture Hall
12:30 - 2:30Break for Lunch / Free Time  
2:30 - 3:15TBA - Rene Vidal, Johns Hopkins University11th Floor Lecture Hall 
3:30 - 4:00Coffee/Tea Break11th Floor Collaborative Space 
4:00 - 4:45Medical Image Report Generation and Beyond - Zhiting Hu, Carnegie Mellon University11th Floor Lecture Hall
5:00 - 6:30Welcome Reception11th Floor Collaborative Space 
Tuesday, February 26, 2019
TimeEventLocationMaterials
9:00 - 9:45Adding Geometry to Learning - Guillermo Sapiro, Duke University11th Floor Lecture Hall 
10:00 - 10:30Coffee/Tea Break 11th Floor Collaborative Space 
10:30 - 11:15Say What You Want to Find - Query-based Search in Images and Video - Kate Saenko, Boston University11th Floor Lecture Hall
11:30 - 11:40Group Photo11th Floor Lecture Hall 
11:40 - 1:30Break for Lunch / Free Time  
1:30 - 2:15View-Invariant Change Captioning - Trevor Darrell, University of California, Berkeley11th Floor Lecture Hall
2:30 - 3:15Understanding hyperspectral images of planetary surfaces - Mario Parente, University of Massachusetts Amherst11th Floor Lecture Hall 
3:30 - 4:00Coffee/Tea Break11th Floor Collaborative Space 
4:00 - 4:45Explainable Query Refinement and Overhead Imagery Analytics - Arslan Basharat, Kitware11th Floor Lecture Hall

Request Reimbursement

Acceptable Costs
  • 1 roundtrip between your home institute and ICERM
  • Flights on U.S. or E.U. airlines – economy class to either Providence airport (PVD) or Boston airport (BOS)
  • Ground Transportation to and from airports and ICERM.
Unacceptable Costs
  • Flights on non-U.S. or non-E.U. airlines
  • Flights on U.K. airlines
  • Seats in economy plus, business class, or first class
  • Change ticket fees of any kind
  • Multi-use bus passes
  • Meals or incidentals
Advance Approval Required
  • Personal car travel to ICERM from outside New England
  • Multiple-destination plane ticket; does not include layovers to reach ICERM
  • Arriving or departing from ICERM more than a day before or day after the program
  • Multiple trips to ICERM
  • Rental car to/from ICERM
  • Flights on a Swiss, Japanese, or Australian airlines
  • Arriving or departing from airport other than PVD/BOS or home institution's local airport
  • 2 one-way plane tickets to create a roundtrip (often purchased from Expedia, Orbitz, etc.)
Reimbursement Request Form

https://icerm.brown.edu/money/

Refer to the back of your ID badge for more information. Checklists are available at the front desk.

Reimbursement Tips
  • Scanned original receipts are required for all expenses
  • Airfare receipt must show full itinerary and payment
  • ICERM does not offer per diem or meal reimbursement
  • Allowable mileage is reimbursed at prevailing IRS Business Rate and trip documented via pdf of Google Maps result
  • Keep all documentation until you receive your reimbursement!
Reimbursement Timing

6 - 8 weeks after all documentation is sent to ICERM. All reimbursement requests are reviewed by numerous central offices at Brown who may request additional documentation.

Reimbursement Deadline

Submissions must be received within 30 days of ICERM departure to avoid applicable taxes. Submissions after thirty days will incur applicable taxes. No submissions are accepted more than six months after the program end.

Associated Semester Workshops

Computer Vision
Algebraic Vision Research Cluster
Computational Imaging
Introduction to the ANTs Ecosystem