Compressed Sensing with Side Information on the Feasible Region

Compressed Sensing with Side Information on the Feasible Region PDF

Author: Mohammad Rostami

Publisher: Springer

Published: 2013-05-15

Total Pages: 69

ISBN-13: 3319003666

DOWNLOAD EBOOK →

This book discusses compressive sensing in the presence of side information. Compressive sensing is an emerging technique for efficiently acquiring and reconstructing a signal. Interesting instances of Compressive Sensing (CS) can occur when, apart from sparsity, side information is available about the source signals. The side information can be about the source structure, distribution, etc. Such cases can be viewed as extensions of the classical CS. In these cases we are interested in incorporating the side information to either improve the quality of the source reconstruction or decrease the number of samples required for accurate reconstruction. In this book we assume availability of side information about the feasible region. The main applications investigated are image deblurring for optical imaging, 3D surface reconstruction, and reconstructing spatiotemporally correlated sources. The author shows that the side information can be used to improve the quality of the reconstruction compared to the classic compressive sensing. The book will be of interest to all researchers working on compressive sensing, inverse problems, and image processing.

Compressed Sensing in the Presence of Side Information

Compressed Sensing in the Presence of Side Information PDF

Author: Mohammad Rostami

Publisher:

Published: 2012

Total Pages: 71

ISBN-13:

DOWNLOAD EBOOK →

Reconstruction of continuous signals from a number of their discrete samples is central to digital signal processing. Digital devices can only process discrete data and thus processing the continuous signals requires discretization. After discretization, possibility of unique reconstruction of the source signals from their samples is crucial. The classical sampling theory provides bounds on the sampling rate for unique source reconstruction, known as the Nyquist sampling rate. Recently a new sampling scheme, Compressive Sensing (CS), has been formulated for sparse signals. CS is an active area of research in signal processing. It has revolutionized the classical sampling theorems and has provided a new scheme to sample and reconstruct sparse signals uniquely, below Nyquist sampling rates. A signal is called (approximately) sparse when a relatively large number of its elements are (approximately) equal to zero. For the class of sparse signals, sparsity can be viewed as prior information about the source signal. CS has found numerous applications and has improved some image acquisition devices. Interesting instances of CS can happen, when apart from sparsity, side information is available about the source signals. The side information can be about the source structure, distribution, etc. Such cases can be viewed as extensions of the classical CS. In such cases we are interested in incorporating the side information to either improve the quality of the source reconstruction or decrease the number of the required samples for accurate reconstruction. A general CS problem can be transformed to an equivalent optimization problem. In this thesis, a special case of CS with side information about the feasible region of the equivalent optimization problem is studied. It is shown that in such cases uniqueness and stability of the equivalent optimization problem still holds. Then, an efficient reconstruction method is proposed. To demonstrate the practical value of the proposed scheme, the algorithm is applied on two real world applications: image deblurring in optical imaging and surface reconstruction in the gradient field. Experimental results are provided to further investigate and confirm the effectiveness and usefulness of the proposed scheme.

Compressed Sensing in Information Processing

Compressed Sensing in Information Processing PDF

Author: Gitta Kutyniok

Publisher: Springer Nature

Published: 2022-10-20

Total Pages: 549

ISBN-13: 3031097459

DOWNLOAD EBOOK →

This contributed volume showcases the most significant results obtained from the DFG Priority Program on Compressed Sensing in Information Processing. Topics considered revolve around timely aspects of compressed sensing with a special focus on applications, including compressed sensing-like approaches to deep learning; bilinear compressed sensing - efficiency, structure, and robustness; structured compressive sensing via neural network learning; compressed sensing for massive MIMO; and security of future communication and compressive sensing.

Compressive Sensing of Earth Observations

Compressive Sensing of Earth Observations PDF

Author: C.H. Chen

Publisher: CRC Press

Published: 2017-05-25

Total Pages: 379

ISBN-13: 1498774385

DOWNLOAD EBOOK →

Future remote sensing systems will make extensive use of Compressive Sensing (CS) as it becomes more integrated into the system design with increased high resolution sensor developments and the rising earth observation data generated each year. Written by leading experts in the field Compressive Sensing of Earth Observations provides a comprehensive and balanced coverage of the theory and applications of CS in all aspects of earth observations. This work covers a myriad of practical aspects such as the use of CS in detection of human vital signs in a cluttered environment and the corresponding modeling of rib-cage breathing. Readers are also presented with three different applications of CS to the ISAR imaging problem, which includes image reconstruction from compressed data, resolution enhancement, and image reconstruction from incomplete data.

An Introduction to Compressed Sensing

An Introduction to Compressed Sensing PDF

Author: M. Vidyasagar

Publisher: SIAM

Published: 2019-12-03

Total Pages: 341

ISBN-13: 161197612X

DOWNLOAD EBOOK →

Compressed sensing is a relatively recent area of research that refers to the recovery of high-dimensional but low-complexity objects from a limited number of measurements. The topic has applications to signal/image processing and computer algorithms, and it draws from a variety of mathematical techniques such as graph theory, probability theory, linear algebra, and optimization. The author presents significant concepts never before discussed as well as new advances in the theory, providing an in-depth initiation to the field of compressed sensing. An Introduction to Compressed Sensing contains substantial material on graph theory and the design of binary measurement matrices, which is missing in recent texts despite being poised to play a key role in the future of compressed sensing theory. It also covers several new developments in the field and is the only book to thoroughly study the problem of matrix recovery. The book supplies relevant results alongside their proofs in a compact and streamlined presentation that is easy to navigate. The core audience for this book is engineers, computer scientists, and statisticians who are interested in compressed sensing. Professionals working in image processing, speech processing, or seismic signal processing will also find the book of interest.

Transfer Learning through Embedding Spaces

Transfer Learning through Embedding Spaces PDF

Author: Mohammad Rostami

Publisher: CRC Press

Published: 2021-06-29

Total Pages: 220

ISBN-13: 1000400573

DOWNLOAD EBOOK →

Recent progress in artificial intelligence (AI) has revolutionized our everyday life. Many AI algorithms have reached human-level performance and AI agents are replacing humans in most professions. It is predicted that this trend will continue and 30% of work activities in 60% of current occupations will be automated. This success, however, is conditioned on availability of huge annotated datasets to training AI models. Data annotation is a time-consuming and expensive task which still is being performed by human workers. Learning efficiently from less data is a next step for making AI more similar to natural intelligence. Transfer learning has been suggested a remedy to relax the need for data annotation. The core idea in transfer learning is to transfer knowledge across similar tasks and use similarities and previously learned knowledge to learn more efficiently. In this book, we provide a brief background on transfer learning and then focus on the idea of transferring knowledge through intermediate embedding spaces. The idea is to couple and relate different learning through embedding spaces that encode task-level relations and similarities. We cover various machine learning scenarios and demonstrate that this idea can be used to overcome challenges of zero-shot learning, few-shot learning, domain adaptation, continual learning, lifelong learning, and collaborative learning.

A Mathematical Introduction to Compressive Sensing

A Mathematical Introduction to Compressive Sensing PDF

Author: Simon Foucart

Publisher: Springer Science & Business Media

Published: 2013-08-13

Total Pages: 634

ISBN-13: 0817649484

DOWNLOAD EBOOK →

At the intersection of mathematics, engineering, and computer science sits the thriving field of compressive sensing. Based on the premise that data acquisition and compression can be performed simultaneously, compressive sensing finds applications in imaging, signal processing, and many other domains. In the areas of applied mathematics, electrical engineering, and theoretical computer science, an explosion of research activity has already followed the theoretical results that highlighted the efficiency of the basic principles. The elegant ideas behind these principles are also of independent interest to pure mathematicians. A Mathematical Introduction to Compressive Sensing gives a detailed account of the core theory upon which the field is build. With only moderate prerequisites, it is an excellent textbook for graduate courses in mathematics, engineering, and computer science. It also serves as a reliable resource for practitioners and researchers in these disciplines who want to acquire a careful understanding of the subject. A Mathematical Introduction to Compressive Sensing uses a mathematical perspective to present the core of the theory underlying compressive sensing.

Compressed Sensing

Compressed Sensing PDF

Author: Yonina C. Eldar

Publisher: Cambridge University Press

Published: 2012-05-17

Total Pages: 557

ISBN-13: 1107394392

DOWNLOAD EBOOK →

Compressed sensing is an exciting, rapidly growing field, attracting considerable attention in electrical engineering, applied mathematics, statistics and computer science. This book provides the first detailed introduction to the subject, highlighting theoretical advances and a range of applications, as well as outlining numerous remaining research challenges. After a thorough review of the basic theory, many cutting-edge techniques are presented, including advanced signal modeling, sub-Nyquist sampling of analog signals, non-asymptotic analysis of random matrices, adaptive sensing, greedy algorithms and use of graphical models. All chapters are written by leading researchers in the field, and consistent style and notation are utilized throughout. Key background information and clear definitions make this an ideal resource for researchers, graduate students and practitioners wanting to join this exciting research area. It can also serve as a supplementary textbook for courses on computer vision, coding theory, signal processing, image processing and algorithms for efficient data processing.

Sparse representation of visual data for compression and compressed sensing

Sparse representation of visual data for compression and compressed sensing PDF

Author: Ehsan Miandji

Publisher: Linköping University Electronic Press

Published: 2018-11-23

Total Pages: 158

ISBN-13: 9176851869

DOWNLOAD EBOOK →

The ongoing advances in computational photography have introduced a range of new imaging techniques for capturing multidimensional visual data such as light fields, BRDFs, BTFs, and more. A key challenge inherent to such imaging techniques is the large amount of high dimensional visual data that is produced, often requiring GBs, or even TBs, of storage. Moreover, the utilization of these datasets in real time applications poses many difficulties due to the large memory footprint. Furthermore, the acquisition of large-scale visual data is very challenging and expensive in most cases. This thesis makes several contributions with regards to acquisition, compression, and real time rendering of high dimensional visual data in computer graphics and imaging applications. Contributions of this thesis reside on the strong foundation of sparse representations. Numerous applications are presented that utilize sparse representations for compression and compressed sensing of visual data. Specifically, we present a single sensor light field camera design, a compressive rendering method, a real time precomputed photorealistic rendering technique, light field (video) compression and real time rendering, compressive BRDF capture, and more. Another key contribution of this thesis is a general framework for compression and compressed sensing of visual data, regardless of the dimensionality. As a result, any type of discrete visual data with arbitrary dimensionality can be captured, compressed, and rendered in real time. This thesis makes two theoretical contributions. In particular, uniqueness conditions for recovering a sparse signal under an ensemble of multidimensional dictionaries is presented. The theoretical results discussed here are useful for designing efficient capturing devices for multidimensional visual data. Moreover, we derive the probability of successful recovery of a noisy sparse signal using OMP, one of the most widely used algorithms for solving compressed sensing problems.