Neural Networks In Optimization

Author : Xiang-Sun Zhang
Publisher : Springer Science & Business Media
Page : 369 pages
File Size : 55,9 Mb
Release : 2013-03-09
Category : Science
ISBN : 9781475731675

Get Book

Neural Networks in Optimization by Xiang-Sun Zhang Pdf

People are facing more and more NP-complete or NP-hard problems of a combinatorial nature and of a continuous nature in economic, military and management practice. There are two ways in which one can enhance the efficiency of searching for the solutions of these problems. The first is to improve the speed and memory capacity of hardware. We all have witnessed the computer industry's amazing achievements with hardware and software developments over the last twenty years. On one hand many computers, bought only a few years ago, are being sent to elementary schools for children to learn the ABC's of computing. On the other hand, with economic, scientific and military developments, it seems that the increase of intricacy and the size of newly arising problems have no end. We all realize then that the second way, to design good algorithms, will definitely compensate for the hardware limitations in the case of complicated problems. It is the collective and parallel computation property of artificial neural net works that has activated the enthusiasm of researchers in the field of computer science and applied mathematics. It is hard to say that artificial neural networks are solvers of the above-mentioned dilemma, but at least they throw some new light on the difficulties we face. We not only anticipate that there will be neural computers with intelligence but we also believe that the research results of artificial neural networks might lead to new algorithms on von Neumann's computers.

Author : Andrzej Cichocki,R. Unbehauen
Publisher : John Wiley & Sons
Page : 578 pages
File Size : 40,6 Mb
Release : 1993-06-07
Category : Computers
ISBN : UOM:39015029550657

Get Book

Neural Networks for Optimization and Signal Processing by Andrzej Cichocki,R. Unbehauen Pdf

A topical introduction on the ability of artificial neural networks to not only solve on-line a wide range of optimization problems but also to create new techniques and architectures. Provides in-depth coverage of mathematical modeling along with illustrative computer simulation results.

Author : Oscar Castillo,Patricia Melin
Publisher : Springer Nature
Page : 383 pages
File Size : 47,9 Mb
Release : 2021-03-24
Category : Technology & Engineering
ISBN : 9783030687762

Get Book

Fuzzy Logic Hybrid Extensions of Neural and Optimization Algorithms: Theory and Applications by Oscar Castillo,Patricia Melin Pdf

We describe in this book, recent developments on fuzzy logic, neural networks and optimization algorithms, as well as their hybrid combinations, and their application in areas such as, intelligent control and robotics, pattern recognition, medical diagnosis, time series prediction and optimization of complex problems. The book contains a collection of papers focused on hybrid intelligent systems based on soft computing. There are some papers with the main theme of type-1 and type-2 fuzzy logic, which basically consists of papers that propose new concepts and algorithms based on type-1 and type-2 fuzzy logic and their applications. There also some papers that presents theory and practice of meta-heuristics in different areas of application. Another group of papers describe diverse applications of fuzzy logic, neural networks and hybrid intelligent systems in medical applications. There are also some papers that present theory and practice of neural networks in different areas of application. In addition, there are papers that present theory and practice of optimization and evolutionary algorithms in different areas of application. Finally, there are some papers describing applications of fuzzy logic, neural networks and meta-heuristics in pattern recognition problems.

Author : George Magoulas,Vassilis P. Plagianakos,Michael N. Vrahatis
Publisher : Springer
Page : 500 pages
File Size : 55,6 Mb
Release : 2015-12-24
Category : Mathematics
ISBN : 144191661X

Get Book

Nonlinear Optimization Approaches for Training Neural Networks by George Magoulas,Vassilis P. Plagianakos,Michael N. Vrahatis Pdf

This book examines how nonlinear optimization techniques can be applied to training and testing neural networks. It includes both well-known and recently-developed network training methods including deterministic nonlinear optimization methods, stochastic nonlinear optimization methods, and advanced training schemes which combine both deterministic and stochastic components. The convergence analysis and convergence proofs of these techniques are presented as well as real applications of neural networks in areas such as pattern classification, bioinformatics, biomedicine, and finance. Nonlinear optimization methods are applied extensively in the design of training protocols for artificial neural networks used in industry and academia. Such techniques allow for the implementation of dynamic unsupervised neural network training without requiring the fine tuning of several heuristic parameters. "Nonlinear Optimization Approaches for Training Neural Networks" is a response to the growing demand for innovations in this area of research. This monograph presents a wide range of approaches to neural networks training providing theoretical justification for network behavior based on the theory of nonlinear optimization. It presents training algorithms, and theoretical results on their convergence and implementations through pseudocode. This approach offers the reader an explanation of the performance of the various methods, and a better understanding of the individual characteristics of the various methods, their differences/advantages and interrelationships. This improved perspective allows the reader to choose the best network training method without spending too much effort configuring highly sensitive heuristic parameters. This book can serve as an excellent guide for researchers, graduate students, and lecturers interested in the development of neural networks and their training.

Author : Joan Cabestany,Francisco Sandoval,Alberto Prieto,Juan Manuel Corchado Rodríguez
Publisher : Springer
Page : 1356 pages
File Size : 55,8 Mb
Release : 2009-06-05
Category : Computers
ISBN : 9783642024788

Get Book

Bio-Inspired Systems: Computational and Ambient Intelligence by Joan Cabestany,Francisco Sandoval,Alberto Prieto,Juan Manuel Corchado Rodríguez Pdf

This volume presents the set of final accepted papers for the tenth edition of the IWANN conference “International Work-Conference on Artificial neural Networks” held in Salamanca (Spain) during June 10–12, 2009. IWANN is a biennial conference focusing on the foundations, theory, models and applications of systems inspired by nature (mainly, neural networks, evolutionary and soft-computing systems). Since the first edition in Granada (LNCS 540, 1991), the conference has evolved and matured. The list of topics in the successive Call for - pers has also evolved, resulting in the following list for the present edition: 1. Mathematical and theoretical methods in computational intelligence. C- plex and social systems. Evolutionary and genetic algorithms. Fuzzy logic. Mathematics for neural networks. RBF structures. Self-organizing networks and methods. Support vector machines. 2. Neurocomputational formulations. Single-neuron modelling. Perceptual m- elling. System-level neural modelling. Spiking neurons. Models of biological learning. 3. Learning and adaptation. Adaptive systems. Imitation learning. Reconfig- able systems. Supervised, non-supervised, reinforcement and statistical al- rithms. 4. Emulation of cognitive functions. Decision making. Multi-agent systems. S- sor mesh. Natural language. Pattern recognition. Perceptual and motor functions (visual, auditory, tactile, virtual reality, etc.). Robotics. Planning motor control. 5. Bio-inspired systems and neuro-engineering. Embedded intelligent systems. Evolvable computing. Evolving hardware. Microelectronics for neural, fuzzy and bio-inspired systems. Neural prostheses. Retinomorphic systems. Bra- computer interfaces (BCI). Nanosystems. Nanocognitive systems.

Author : Anand J. Kulkarni,Suresh Chandra Satapathy
Publisher : Springer Nature
Page : 202 pages
File Size : 42,9 Mb
Release : 2019-11-29
Category : Technology & Engineering
ISBN : 9789811509940

Get Book

Optimization in Machine Learning and Applications by Anand J. Kulkarni,Suresh Chandra Satapathy Pdf

This book discusses one of the major applications of artificial intelligence: the use of machine learning to extract useful information from multimodal data. It discusses the optimization methods that help minimize the error in developing patterns and classifications, which further helps improve prediction and decision-making. The book also presents formulations of real-world machine learning problems, and discusses AI solution methodologies as standalone or hybrid approaches. Lastly, it proposes novel metaheuristic methods to solve complex machine learning problems. Featuring valuable insights, the book helps readers explore new avenues leading toward multidisciplinary research discussions.

Author : Cornelius T. Leondes
Publisher : Elsevier
Page : 398 pages
File Size : 49,5 Mb
Release : 1998-02-09
Category : Science
ISBN : 0080551351

Get Book

Optimization Techniques by Cornelius T. Leondes Pdf

Optimization Techniques is a unique reference source to a diverse array of methods for achieving optimization, and includes both systems structures and computational methods. The text devotes broad coverage toa unified view of optimal learning, orthogonal transformation techniques, sequential constructive techniques, fast back propagation algorithms, techniques for neural networks with nonstationary or dynamic outputs, applications to constraint satisfaction,optimization issues and techniques for unsupervised learning neural networks, optimum Cerebellar Model of Articulation Controller systems, a new statistical theory of optimum neural learning, and the role of the Radial Basis Function in nonlinear dynamical systems.This volume is useful for practitioners, researchers, and students in industrial, manufacturing, mechanical, electrical, and computer engineering. Provides in-depth treatment of theoretical contributions to optimal learning for neural network systems Offers a comprehensive treatment of orthogonal transformation techniques for the optimization of neural network systems Includes illustrative examples and comprehensive treatment of sequential constructive techniques for optimization of neural network systems Presents a uniquely comprehensive treatment of the highly effective fast back propagation algorithms for the optimization of neural network systems Treats, in detail, optimization techniques for neural network systems with nonstationary or dynamic inputs Covers optimization techniques and applications of neural network systems in constraint satisfaction

Author : Thomas, J. Joshua,Karagoz, Pinar,Ahamed, B. Bazeer,Vasant, Pandian
Publisher : IGI Global
Page : 355 pages
File Size : 42,6 Mb
Release : 2019-11-29
Category : Computers
ISBN : 9781799811947

Get Book

Deep Learning Techniques and Optimization Strategies in Big Data Analytics by Thomas, J. Joshua,Karagoz, Pinar,Ahamed, B. Bazeer,Vasant, Pandian Pdf

Many approaches have sprouted from artificial intelligence (AI) and produced major breakthroughs in the computer science and engineering industries. Deep learning is a method that is transforming the world of data and analytics. Optimization of this new approach is still unclear, however, and there’s a need for research on the various applications and techniques of deep learning in the field of computing. Deep Learning Techniques and Optimization Strategies in Big Data Analytics is a collection of innovative research on the methods and applications of deep learning strategies in the fields of computer science and information systems. While highlighting topics including data integration, computational modeling, and scheduling systems, this book is ideally designed for engineers, IT specialists, data analysts, data scientists, engineers, researchers, academicians, and students seeking current research on deep learning methods and its application in the digital industry.

Author : Tamir Hazan,George Papandreou,Daniel Tarlow
Publisher : MIT Press
Page : 413 pages
File Size : 54,7 Mb
Release : 2023-12-05
Category : Computers
ISBN : 9780262549943

Get Book

Perturbations, Optimization, and Statistics by Tamir Hazan,George Papandreou,Daniel Tarlow Pdf

A description of perturbation-based methods developed in machine learning to augment novel optimization methods with strong statistical guarantees. In nearly all machine learning, decisions must be made given current knowledge. Surprisingly, making what is believed to be the best decision is not always the best strategy, even when learning in a supervised learning setting. An emerging body of work on learning under different rules applies perturbations to decision and learning procedures. These methods provide simple and highly efficient learning rules with improved theoretical guarantees. This book describes perturbation-based methods developed in machine learning to augment novel optimization methods with strong statistical guarantees, offering readers a state-of-the-art overview. Chapters address recent modeling ideas that have arisen within the perturbations framework, including Perturb & MAP, herding, and the use of neural networks to map generic noise to distribution over highly structured data. They describe new learning procedures for perturbation models, including an improved EM algorithm and a learning algorithm that aims to match moments of model samples to moments of data. They discuss understanding the relation of perturbation models to their traditional counterparts, with one chapter showing that the perturbations viewpoint can lead to new algorithms in the traditional setting. And they consider perturbation-based regularization in neural networks, offering a more complete understanding of dropout and studying perturbations in the context of deep neural networks.

Author : Seyedali Mirjalili,Hossam Faris,Ibrahim Aljarah
Publisher : Springer Nature
Page : 286 pages
File Size : 42,8 Mb
Release : 2019-11-11
Category : Technology & Engineering
ISBN : 9789813299900

Get Book

Evolutionary Machine Learning Techniques by Seyedali Mirjalili,Hossam Faris,Ibrahim Aljarah Pdf

This book provides an in-depth analysis of the current evolutionary machine learning techniques. Discussing the most highly regarded methods for classification, clustering, regression, and prediction, it includes techniques such as support vector machines, extreme learning machines, evolutionary feature selection, artificial neural networks including feed-forward neural networks, multi-layer perceptron, probabilistic neural networks, self-optimizing neural networks, radial basis function networks, recurrent neural networks, spiking neural networks, neuro-fuzzy networks, modular neural networks, physical neural networks, and deep neural networks. The book provides essential definitions, literature reviews, and the training algorithms for machine learning using classical and modern nature-inspired techniques. It also investigates the pros and cons of classical training algorithms. It features a range of proven and recent nature-inspired algorithms used to train different types of artificial neural networks, including genetic algorithm, ant colony optimization, particle swarm optimization, grey wolf optimizer, whale optimization algorithm, ant lion optimizer, moth flame algorithm, dragonfly algorithm, salp swarm algorithm, multi-verse optimizer, and sine cosine algorithm. The book also covers applications of the improved artificial neural networks to solve classification, clustering, prediction and regression problems in diverse fields.

Author : Hitoshi Iba,Nasimul Noman
Publisher : Springer Nature
Page : 437 pages
File Size : 48,9 Mb
Release : 2020-05-20
Category : Computers
ISBN : 9789811536854

Get Book

Deep Neural Evolution by Hitoshi Iba,Nasimul Noman Pdf

This book delivers the state of the art in deep learning (DL) methods hybridized with evolutionary computation (EC). Over the last decade, DL has dramatically reformed many domains: computer vision, speech recognition, healthcare, and automatic game playing, to mention only a few. All DL models, using different architectures and algorithms, utilize multiple processing layers for extracting a hierarchy of abstractions of data. Their remarkable successes notwithstanding, these powerful models are facing many challenges, and this book presents the collaborative efforts by researchers in EC to solve some of the problems in DL. EC comprises optimization techniques that are useful when problems are complex or poorly understood, or insufficient information about the problem domain is available. This family of algorithms has proven effective in solving problems with challenging characteristics such as non-convexity, non-linearity, noise, and irregularity, which dampen the performance of most classic optimization schemes. Furthermore, EC has been extensively and successfully applied in artificial neural network (ANN) research —from parameter estimation to structure optimization. Consequently, EC researchers are enthusiastic about applying their arsenal for the design and optimization of deep neural networks (DNN). This book brings together the recent progress in DL research where the focus is particularly on three sub-domains that integrate EC with DL: (1) EC for hyper-parameter optimization in DNN; (2) EC for DNN architecture design; and (3) Deep neuroevolution. The book also presents interesting applications of DL with EC in real-world problems, e.g., malware classification and object detection. Additionally, it covers recent applications of EC in DL, e.g. generative adversarial networks (GAN) training and adversarial attacks. The book aims to prompt and facilitate the research in DL with EC both in theory and in practice.

Author : Duc Pham,D. Karaboga
Publisher : Springer Science & Business Media
Page : 308 pages
File Size : 47,8 Mb
Release : 2012-12-06
Category : Computers
ISBN : 9781447107217

Get Book

Intelligent Optimisation Techniques by Duc Pham,D. Karaboga Pdf

This work gives a concise introduction to four important optimization techniques, presenting a range of applications drawn from electrical, manufacturing, mechanical, and systems engineering-such as the design of microstrip antennas, digital FIR filters, and fuzzy logic controllers. The book also contains the C programs used to implement the main techniques for those wishing to experiment with them.

Author : Seyedali Mirjalili
Publisher : Springer
Page : 156 pages
File Size : 43,6 Mb
Release : 2018-06-26
Category : Technology & Engineering
ISBN : 9783319930251

Get Book

Evolutionary Algorithms and Neural Networks by Seyedali Mirjalili Pdf

This book introduces readers to the fundamentals of artificial neural networks, with a special emphasis on evolutionary algorithms. At first, the book offers a literature review of several well-regarded evolutionary algorithms, including particle swarm and ant colony optimization, genetic algorithms and biogeography-based optimization. It then proposes evolutionary version of several types of neural networks such as feed forward neural networks, radial basis function networks, as well as recurrent neural networks and multi-later perceptron. Most of the challenges that have to be addressed when training artificial neural networks using evolutionary algorithms are discussed in detail. The book also demonstrates the application of the proposed algorithms for several purposes such as classification, clustering, approximation, and prediction problems. It provides a tutorial on how to design, adapt, and evaluate artificial neural networks as well, and includes source codes for most of the proposed techniques as supplementary materials.

Author : Laszlo Berke
Publisher : Unknown
Page : 20 pages
File Size : 49,6 Mb
Release : 1993
Category : Expert systems (Computer science)
ISBN : NASA:31769000521685

Get Book

Application of Artificial Neural Networks to the Design Optimization of Aerospace Structural Components by Laszlo Berke Pdf

Author : Martin Hänggi,George S. Moschytz
Publisher : Springer Science & Business Media
Page : 155 pages
File Size : 47,5 Mb
Release : 2013-03-09
Category : Technology & Engineering
ISBN : 9781475732207

Get Book

Cellular Neural Networks by Martin Hänggi,George S. Moschytz Pdf

Cellular Neural Networks (CNNs) constitute a class of nonlinear, recurrent and locally coupled arrays of identical dynamical cells that operate in parallel. ANALOG chips are being developed for use in applications where sophisticated signal processing at low power consumption is required. Signal processing via CNNs only becomes efficient if the network is implemented in analog hardware. In view of the physical limitations that analog implementations entail, robust operation of a CNN chip with respect to parameter variations has to be insured. By far not all mathematically possible CNN tasks can be carried out reliably on an analog chip; some of them are inherently too sensitive. This book defines a robustness measure to quantify the degree of robustness and proposes an exact and direct analytical design method for the synthesis of optimally robust network parameters. The method is based on a design centering technique which is generally applicable where linear constraints have to be satisfied in an optimum way. Processing speed is always crucial when discussing signal-processing devices. In the case of the CNN, it is shown that the setting time can be specified in closed analytical expressions, which permits, on the one hand, parameter optimization with respect to speed and, on the other hand, efficient numerical integration of CNNs. Interdependence between robustness and speed issues are also addressed. Another goal pursued is the unification of the theory of continuous-time and discrete-time systems. By means of a delta-operator approach, it is proven that the same network parameters can be used for both of these classes, even if their nonlinear output functions differ. More complex CNN optimization problems that cannot be solved analytically necessitate resorting to numerical methods. Among these, stochastic optimization techniques such as genetic algorithms prove their usefulness, for example in image classification problems. Since the inception of the CNN, the problem of finding the network parameters for a desired task has been regarded as a learning or training problem, and computationally expensive methods derived from standard neural networks have been applied. Furthermore, numerous useful parameter sets have been derived by intuition. In this book, a direct and exact analytical design method for the network parameters is presented. The approach yields solutions which are optimum with respect to robustness, an aspect which is crucial for successful implementation of the analog CNN hardware that has often been neglected. `This beautifully rounded work provides many interesting and useful results, for both CNN theorists and circuit designers.' Leon O. Chua