Adaptive and Intelligent Systems Applications 1994-1999 - Final Report | |
Main page Preface Program summary Research projects 1994-1998 Research projects 1998-1999 Product development projects 1994-1999 |
2. Dynamic systems modeling (DYSMO)
AbstractDesign and control of elevators becomes more and more demanding with increasing speed, especially in high-rise buildings. The general goal of the project was to develop methods for further enhancing ride comfort and speed of modern elevators. Better control also enables more accurate and faster rides that increase the capacity of the elevator systems.The main goal of the project was to develop a method for building simulation models of elevators for the development of new control schemes. VTT Automation was responsible of the experimental design that was carried out in close cooperation with Kone Elevators and the Automation and Control Institute of Tampere University of Technology (TTKK). The actual measurements were performed by Kone Elevators.
ResultsSimulators of two existing elevator types (SCD and V3F elevators) were developed [1, 2]. The models were based on equations of motion and empirical models for viscoelastic and friction phenomena. An experimental set-up and test runs were carefully designed and performed for the identification and validation of the models.In the simulation models, the friction forces are described by feedforward neural networks and the viscoelastic properties of the rope depend on rope length. The rope tension could be predicted with sufficient accuracy for simulation purposes. Simulators of the both elevator types were implemented by using Matlab and are described in detail in a report also describing the models [1]. An analysis of the starting vibrations of an existing elevator was also performed and reported. The incorporation of the very strongly nonlinear friction force models into the dynamic simulator revealed a general problem related to neural network and other empirical models that are based on process data. Real process data are always strongly correlated due to automated feedback controllers and operator control. Thus the interesting region in the data space is only partly covered. The neural networks models that accurately approximate strong nonlinearities may give unrealistic predictions even slightly outside the region covered by the available observations used for the training and validation. A principle was developed for avoiding the use of a neural network model outside its validity domain [3]. The principle is based on clustering the regressor training data and projecting the input vector to the validity domain defined by the cluster centers. The confidence level for the projection can be specified. In the friction force model, Fuzzy C-means clustering was utilized. Another example of a lime kiln process was also reported in the paper describing the general method [3]. The model development methods and experimental designs can be applied to new elevator types. The simulators can be used in elevator design, ride planning, control development, analysis of vibration problems, and training. The developed instrumentation and experimental designs for model identification have already been used for the analysis of new elevator types.
Project informationParticipants
Project dates1.3.1995-31.12.1996
Project volumeFIM 543.000
Project managerDr. Jari HämäläinenTel: +358 9 456 6467 E-mail: jari.hamalainen@vtt.fi Publications1. Lehtinen H. and J.J. Hämäläinen. Elevator dynamics simulator. Report for Kone Elevators, 1997, 200 p. (confidential).2. Lehtinen H., J.J. Hämäläinen, P. Torenius and T. Tyni. Simulation of elevator dynamics. 2nd Tampere International Conference on Machine Automation, ICMA´98, 15-18-September 1998, Tampere, Finland, 1998. 3. Hämäläinen J.J and I. Järvimäki. Input projection method for safe use of neural networks based on process data. Proceeding of IEEE World Congress on Computational Intelligence, IJCNN ’98 , 4-9 May 1998, Alaska, 1998.
AbstractThe combustion quality of biofuel is heterogeneous and causes problems for control of power plants. The quality of the fuel cannot be measured by on-line methods.The goal of the project was to (1) develop methods for indirect estimation of fuel quality by using only the standard measurements available in the plant and (2) utilize the methods for fast compensation of the changes in quality and enhance plant control. The project was carried out in close cooperation with VTT Automation and a Finnish power company, Imatran Voima Oy (IVO). The collection of data and testing of the methods was performed by IVO. The data were analyzed and methods developed by VTT Automation. IVO was responsible for implementing the new method in the process control system of an existing power plant.
ResultsA new index, FQV (Fuel Quality Value), describing fuel quality was developed and its on-line calculation tested in an existing power plant [2]. FQV is based on the comparison of two estimates of fuel power. Only standard on-line measurements available in the plant and plant specific parameters that can easily be estimated are used. Power is predicted by a dynamic empirical model.The calculation of FQV was tested by extensive off-line simulations and also on-line in the plant. The analysis of several variables (11) by using PCA (Principal Component Analysis) and SOM (Self Organizing Map) confirmed that FQV reliably estimated fuel quality. A method was developed for the utilization of the index in plant control. The method was tested by simulations and implemented in a power plant. The initial on-line testing of the new control scheme revealed that some changes are still necessary in the process control system. These changes can only be made during service intervals and will be completed in June 1998. Two new models were developed and compared for the estimation of fuel power [1]. In the more traditional Hammerstein model the oxygen cost of combustion was estimated based on the total air flow feed and flue gas oxygen concentration. The steam power could then be predicted by using an ARX structure. The developed model predicted the power with sufficient accuracy. A dynamic nonlinear feedforward neural network model was also identified. The model inputs were the air-flow and flue gas oxygen concentration signals with only standard filtering but without explicit calculation of the oxygen cost. The predictions of the neural network model were slightly more accurate. The conclusion was that in spite of slightly better predictions given by the neural network the Hammerstein model is more convenient in this application. The recalibration of the Hammerstein model is straightforward and can be automated if necessary. The retraining of the neural network demands experienced R&D staff and is not so straightforward. The filtering of the signals and the determination of the related delays was very demanding. The delays could only be estimated by fitting low order ARX models between the input and output signals and the determination of the delay by trial and error. During the last year of the project, methods were tested for the monitoring and visualization of the process [2]. The goal was to evaluate the information content of the several temperature measurements of the bed and also the reliability of FQV as an indicator of fuel quality. The results showed that the temperature distribution was not significant and the first principal component of the temperatures could be used. The analysis of eleven (11) variables including the estimated FQV by PCA and SOM component surfaces proved to give similar results. The expected relationships between the variables could be observed and the results confirmed FQV as a reliable fuel quality estimator. New ideas for operator support monitoring and visualization emerged, but were not realized in this project. Two computer programs were developed: (1) off-line simulation of FQV with monitors to the selected most important variables and (2) off-line prediction of steam power by Hammerstein and NN models. IVO is responsible for further testing of FQV and the control algorithms. The company has already decided to start a product development project if the results of the final tests are positive.
Project informationParticipants
Project dates1.3.1995-28.2.1998
Project volumeFIM 1.368.000
Project managerDr. Jari HämäläinenTel: +358 9 456 6467 E-mail: jari.hamalainen@vtt.fi PublicationsBärman R., J. Hämäläinen, M. Välisuo, A. Andersin and K. Ikonen. Estimation of Fuel Power by Models Identified Based on Process Measurements: Comparison of Hammerstein and Neural Network Models (Voimalaitoksen polttoainetehon estimointi prosessimittauksista identifioiduilla malleilla: neuroverkkomallin ja Hammerstein -mallin vertailu). Automaatio 97, Helsinki, Suomen Automaatioseura ry, 1997, 6 p. (CD-ROM, in Finnish).Bärman R. and J.J. Hämäläinen. Modeling, Analysis and Comtrol of Combustion (Turve- ja biopolttoainevoimalaitosten mittaustiedon jalostaminen ja palamisen hallinnan kehittäminen). Report for Imatran Voima, 1998, 100 p. (confidential, in Finnish).
The original Wiener representation
consists of linear dynamics (Laguerre filters) and static nonlinear mapping
(polynomial expansion). In Wiener-NN, static nonlinear mapping is approximated
with NN. The feedforward Wiener-MLP is suitable for modeling of finite memory
systems. The Wiener-MLP with feedback can also be used for modeling of
autonomous type systems, such as fermentation processes.
Due to robust orthogonal (e.g.
Laguerre) description of signals, Wiener-MLP or -SOM classifiers are
advantageous for recognition of spatio-temporal patterns needed in process
monitoring. A method using Wiener-type MLP or SOM classifiers for detecting and
recognizing the functional states on-line was developed and was demonstrated
with Bacillus subtilis fermentation.
The Laguerre descriptions of the
signals realize the state in different Wiener-NNs. In the NOE case, the
state-space formulation was utilized in parameter estimation with the Extended
Kalman filter, which can also be used directly as a state estimator in
connection with the NFIR and NOE-type Wiener-NN models.
The various Wiener models were applied
to model the dynamics of industrial chromatographic separation columns and
industrial Tricoderma fungi
fermentation for monitoring, state estimation, on-line simulation and fault
diagnosis. The chromatographic separation process was also modeled with hybrid
models: some parameter dependencies in the traditional mechanistic model
(partial differential equation) were described with different black-box
mappings.
The original Wiener model is an
input-output representation consisting of linear dynamics (Laguerre filters)
and static nonlinear mapping (Hermite polynomial expansion). In the developed
Wiener-MLP, static nonlinear mapping is realized with MLP, but other static
NN-mappings can also be used. Approximation with MLP is in many cases much more
efficient than approximation with power series. The essential difference
between the nonlinear regression models and Wiener-NN models is the content of
the ‘regression vector’. The regressors in traditional regression models are
sliding data windows of signals, but the ‘regressors’ in Wiener models are the
coefficients of the orthogonal Laguerre expansions of the past signals
calculated on-line with corresponding Laguerre filters. With this
representation, it is possible to describe even long histories in a robust way
with few coefficients by parameterizing the Laguerre basis functions to cover
just the required history. Kautz (or Meixner) orthogonal basis and corresponding
filters can also be used instead of Laguerre basis. Kautz is suitable for
modeling oscillatory systems.
The feedforward Wiener-MLP is of
NFIR-type and can be used as a simulator. It is suitable for modeling fading
memory systems. In the NFIR-type models, the output is a nonlinear static
function of the history description of the input. If the settling time of the
process is long and the sample time must be short, the NFIR-type regression
models cannot be used due to the required dimension being too high, but the
dimension of a sufficient Wiener-MLP can be quite modest.
The Wiener structure can also be used
for modeling autonomous type systems by feeding back some of the outputs of the
Wiener-MLP to the input of the Laguerre system. In this case, the state
consists of Laguerre descriptions of the outputs fed back and Laguerre
descriptions of the real inputs. In NOE type Wiener-MLP with feedback
simulator, certain model outputs are fed back. When some on-line measurements,
which reflect the process state, are fed as inputs to the feedforward
Wiener-MLP in addition to real process inputs, the structure is actually a
NARX-type Wiener-MLP with feedback predictor.
The Extended Kalman filter can be used
in the recursive estimation of the parameters of the MLP. In the NOE case, it
brings convergence and a stability advantage relative to RPEM with GN, because
the update mechanism in the Kalman filter also corrects the model outputs fed
back during estimation. By decreasing the covariance matrices for process state
and parameter ‘state’ during estimation, the degree of NOE behavior can be
increased, which has a positive effect on parameter convergence to suitable NOE
values.
PublicationsVisala A. & Halme A. (1996): Quality Assurance in Bioprocesses by Model Based Fault Diagnosis and State Estimation. Preprints of the 13th IFAC World Congress, San Fransisco, USA, 30th June- 5th July 1996, Volume N pages 425-430.Visala A. & Halme A. (1996): Recognition of Functional States on the Basis of Laguerre Presentation. CESA'96 IMACS Multiconference Symposium on Control, Optimization and Supervision, Lille, France, July 9-12 1996, Vol 1, pages 263-268. Visala A., Pitkänen H. and Halme A. (1997): Describing the dynamics of a chromatographic separation process with Wiener-type NN-model. A poster in 10th International Conference in Aqueous Two-Phase Systems (SCI), 10-15 August 1997, Reading, UK. Visala A., Pitkänen H. and Halme A. (1997): Wiener-type SOM- and MLP-classifiers for recognition of the dynamic modes. In Artificial Neural Networks ICANN'97, 7th International Conference, Lausanne, Switzerland, October 1997, Proceedings, edited by W. Gerstner, M. Hasler, J.-D. Nicoud, Lecture Notes in Computer Science 1327, Springer. Visala A. (1998): Identification of Wiener-MLP with Feedback NOE-Model with Extended Kalman Filter. 1998 IEEE World Congress on Computational Intelligence (IJCNN '98) Anchorage, Alaska, May 4-9, 1998. Visala A. and Halme A. (1998): Dynamic Wiener-MLP with feedback NOE-model for Tricoderma Fermentation. 7th Int. Conf. on Computer Applications in Biotechnology – CAB7, May 31-June 4, 1998, Osaka, Japan. Visala A., Pitkänen H. and Halme A. (1998): Describing the dynamics of a chromatographic separation process with Wiener-type NN-model. Practical Manuscript, approved for publication in Journal of Chromatography B. Visala A., Pitkänen H. and Halme A. (199X): Describing the dynamics of a chromatographic separation process with Wiener-type NN-model. Manuscript, invited to resubmit after revision for publication in Journal of process control.
AbstractThe main objective of the work was to study and apply neural networks to district heat load forecasting. A reliable and accurate forecasting method is essential for optimum energy production in district heating plants. The work carried out was divided into three main components, a) design of a suitable neural network model for implementation which can be identified using small amount of data, b) implementing the adaptation into the forecaster and c) implementation of the forecaster into the process information system.
ResultsThe models based on physical knowledge, i.e. district heat network component level modeling, are too complex to maintain due to continuous changes in the network. This complexity creates a need for a simpler, adaptive model which is accurate enough for production optimization purposes.The main input arguments are the values of ambient temperature and district heat generation. The dynamics of the district heat network are brought into the model by using various filtered ambient temperatures as input variables. The problematic nature of human behavior was overcome by implementing time and weekday information into a sparse multimodel network structure. The multimodel structure combines a nominal model which functions as a forecaster for Tuesday to Thursday and three special models for Monday, Friday and Saturday-Sunday time periods. The last three models take into account the rhythms caused by industry and regional habits e.g. heating up office buildings after a weekend and common sauna days. The basic structure of the neural network model was built and verified during the first project year. The model is a standard nonlinear autoregressive model with a moving average (NARX). The implementation is a standard, fully connected, multilayer perceptron network and the parameters were optimized using the Levenberg-Marquardt optimization algorithm. During the second and third years it became obvious that the main goal from the industrial point of view was a model which can function reliably on a different heat load network without any training until the first winter has passed. This problem was solved by introducing a median filter construction and a database. The median filters are used to remove the one to two hour abnormal peaks from the heat load information. The database stores the previous corrections and functions as a memory for the forecaster enabling the model to function within a few weeks. The database collects the errors between the model and the current situation and then the error correction algorithm adds a correction into the model’s output. This construction enables adaptation of the model to the current situation whether it is a new district heat load region or a modification of an old network. The forecaster with error correction can forecast 48 hours ahead with 10% accuracy. The forecaster parameters were optimized using the data available from years 1995-96 and in the validation data from year 1996-97 was used. The 10% accuracy was truly a good performance since there were some heat production numbers missing from the validation data. Encouraged by these results, final validations were decided and comparisons between the time series model, the model without the error correction and the model with the error correction which are taking place. The validations are based on the earlier optimized forecasters and data from winter 1997-98. The industrial partner decides after these test in which form they will implement the forecaster into their new process plant information system. The development of a research project into a successful product requires both complete documentation of the methodology and engineering solutions required for fault tolerant industrial application. These requirements were emphasized during the final project year to guarantee the means for direct development into a standard part of the district heat product plant’s optimization tools. This documentation will be completed during the first half of April.
Project informationParticipantsThis project is a joint effort of Tampere University of Technology Automation and Control Institute and Imatran Voima Corporation (IVO).
Project dates1.3.1995-28.2.1998The project evolved during the work and also the milestone dates and goals evolved with the project. The project dates presented here are a modification of the original dates due the changed project goals.
Project year 1995-96
Project year 1996-97
Project year 1997-98
Project volumeFIM 739.000
Project managerProf. Heikki KoivoTel: +358 9 4513320 E-mail: heikki.koivo@hut.fi Publications[1] Lehtoranta O. Neural Network based district heat load forecasting system (in Finnish). Master of Science Thesis. Tampere. Tampere University of Technology, Department of Automation Engineering, 1996. Confidential.[2] Lehtoranta, O. Seppälä, J. Koivisto, H. Koivo, H. 1997. Neural Network Based District Heat Load ForecastingPoster. Automaatiopäivät 97, Helsinki. [3] Koivisto, H. 1995. A practical approach to model based neural network control. Dissertation. Tampere. Tampere University of Technology, Department of Electrical Engineering. [4] Seppälä, J. Koivisto, H. and Koivo, H. 1998. Adaptive Neural Network Based District Heat Load forecaster. To be submitted.
AbstractThe main objective of the work was to study the usefulness of neural networks in modeling an elevator. Ride comfort has an increasing role in the elevator business. Simulation can be used in obtaining valuable information on ride comfort for use in development. A good model can be used in off-line control design and the implementation of new advanced control schemes.The work carried out was divided into four main components, a) designing a portable measurement strategy which holds all the necessary tests for the identification of an elevator, b) modeling the test elevator, c) real-time verification of the model and d) designing a model based control strategy. The results show that the empirical model implemented within a neural network framework was able to represent the real process in fine detail. Since both the physical and black-box model needed a certain amount of experimentation due to unknown physical dependencies, a neural network was identified with a little extra effort compared to the first principles model. A portable measurement plan was designed including all necessary measurements needed in the identification of a mechanistic and neural network model. Portability was tested when Kone Oy personnel, encouraged by good results, decided to change the test elevator into a different type of construction which has more non-linear aspects. During the design of new tests only minor changes needed to be made to the previously designed measurement plan. During the project, non-linear output-error neural network (NOE) models for elevator dynamics and motor torque were developed. This type of recurrent non-linear dynamical model represents the deterministic part of the process and is especially suitable for simulation purposes like control design, for instance. The elevator model is a hybrid linear-non-linear neural network. Non-linear part of the model describes the dynamics from selected inputs to the car acceleration which is essential to ride comfort. The linear part implements the physical dependency of a = v’ = x’’, i.e. the integral of acceleration is velocity and the integral of velocity is distance. This ’gray-box’ modeling scheme incorporates physical process knowledge into the neural network structure, resulting in a less complex identification task and a more robust and reliable model. The identified network model is also suitable for on-line control. The motor torque model is a standard recurrent fully connected neural network model which is capable of forecasting the output torque of direct current motor and as such is an essential part of the new torque based control scheme design. The hybrid linear-nonlinear network was combined into one sparse network. This construction and parameter optimization scheme was carried out by using advanced software tool developed in an earlier project. Use of a recurrent neural network (NOE) was essential for obtaining reliable results. This requires both a proper recurrent gradient computation algorithm and an advanced parameter update algorithm. The Levenberg-Marquardt algorithm was used in this study. The both models were combined into a modular simulation environment. The environment is implemented as a Matlab Simulink model and consists of three blocks. The first block contains the elevator control system, the second contains the model for direct current motor and the third contains the elevator dynamics model. The modular environment enables any of the blocks to be changed which results in a simulation system that combines the ability to easily use conventional models or sophisticated models in place of an elevator dynamics model and motor torque model. The module for the control system enables the design of new control schemes just by changing the block or testing and improving currently used schemes by offline simulation. The results show that the empirical model implemented within a neural network framework was able to represent the real processes in fine detail. Since both the physical and black-box model required a certain amount of experimentation due to unknown physical dependencies, a neural network was identified with a little extra effort compared to the first principles model.
Project informationParticipantsThis project was carried out in cooperation with Kone Elevators Oy. The personnel of Kone Oy selected a suitable elevator, prepared the necessary instrumentation and ran the planned tests on the test elevator.
Project dates1.3.1995-31.12.1996The design of the portable measurement strategy was finished slightly behind schedule due to the instrumentation problems affecting the measurement plan. The neural network model was finished on time although improvement of the model has continued. The real-time verification and model based control strategy design have been re-scheduled due to good results in modeling which led to changing the test elevator. During the project year 1996 was decided to leave out the real time tests and concentrate on finishing the modular test environment.
Project year 1995-96
Project year 1996
Project volumeFIM 300.000
Project managerProf. Heikki KoivoTel: +358 9 4513320 E-mail: heikki.koivo@hut.fi Publications1. Seppälä Jari. 1996. Neural Network Model for SCD elevator (in Finnish). Master of Science Thesis. Tampere. Tampere University of Technology, Department of Automation Engineering. Confidential.2. Seppälä, J. Koivisto, H and Koivo, H. Modelling Elevator Dynamics using Neural Networks. International Joint Conference on Neural Networks '98, Anchorage, Alaska, May 4-9, 1998. 3. Seppälä, J. Koivisto, H and Koivo, H. Neural Network Model for Elevator Dynamics. Automaatio-97, Helsinki, September 23-24, 1997.
4. Koivisto, H. 1995. A practical approach to model based
neural network control.
5. Tarkiainen, M. 1995. Modelling of elevator and effect of
speed control on car
jukka.iivarinen@hut.fi http://www.cis.hut.fi/neuronet/Tekes/2.shtml Tuesday, 28-Nov-2000 15:29:03 EET |