optimization

Chaabane Mankai

Surrounded by bright minds and groundbreaking research, KAUST is a great place to learn and grow.

Ahmed Youssef Ragab Radwan

Visiting Student (former), Information Science Lab
Visiting student at the Information Science Lab, in the Electrical Engineering Department, CEMSE, King Abdullah University of Science and Technology (KAUST)

Understanding a Block of Layers in Deep Neural Networks: Optimization, Probabilistic and Tropical Geometric Perspectives

-

KAUST

In this dissertation, we aim at theoretically studying and analyzing deep learning models. Since deep models substantially vary in their shapes and sizes, in this dissertation, we restrict our work to a single fundamental block of layers that is common in almost all architectures. The block of layers of interest is the composition of an affine layer followed by a nonlinear activation function and then lastly followed by another affine layer. We study this block of layers from three different perspectives. (i) An Optimization Perspective. We try addressing the following question: Is it possible that the output of the forward pass through the block of layers highlighted above is an optimal solution to a certain convex optimization problem? As a result, we show an equivalency between the forward pass through this block of layers and a single iteration of certain types of deterministic and stochastic algorithms solving a particular class of tensor formulated convex optimization problems.

Aerial Path Planning for Urban Scene Reconstruction: A Continuous Optimization Method and Benchmark

1 min read ·
Small unmanned aerial vehicles (UAVs) are ideal capturing devices for high-resolution urban 3D reconstructions using multi-view stereo. Nevertheless, practical considerations such as safety usually mean that access to the scan target is often only available for a short amount of time, especially in urban environments. It, therefore, becomes crucial to perform both view and path planning to minimize flight time while ensuring complete and accurate reconstructions. In this work, we address the challenge of automatic view and path planning for UAV-based aerial imaging with the goal of urban

Adel is invited to give a talk in EECVC on "Optimization meets Deep Learning"

1 min read ·
​Adel is invited to give a talk in EECVC on "Optimization meets Deep Learning"​. It is a 45 minutes talk scheduled on the 6th of July 2019.

Adel Bibi

Adel Bibi is a postdoctoral research assistant in computer vision and machine learning at the Torr Vision Group working with Professor Philip Torr at the University of Oxford. Prior to that, he received his MSc and PhD degrees from King Abdullah University of Science & Technology (KAUST) where he was part of the Image and Video Understanding Lab (IVUL) advised by Professor Bernard Ghanem. Education and Early Career Adel Bibi has a Bachelor’s Degree in Electrical Engineering from Kuwait University in 2014. He received his Master Degree in Electrical Engineering from King Abdullah University of