APPLICATION OF DEEP LEARNING NEURAL NETWORK FOR CLASSIFICATION OF BIG DATA OF ASTRONOMIC OBSERVATIONS

DOI: https://doi.org/10.15407/rpra22.04.270

A. A. Gorbunov, E. A. Isaev, V. A. Samodurov

Abstract


PACS numbers: 07.05.Tp,
98.35.-a 

Purpose: In the process of astronomical observations vast amounts of data are collected. The BSA (Big Scanning Antenna) used in the study of impulse phenomena, daily logs 87.5 GB of data (32 TB per year). The aim of this work is to develop the web-service which assists the experts with classification of new astronomic observations. The Azure Machine Learning Studio which offers a Deep Neural Network algorithm is used as a tool for web-service developing.

Design/methodology/approach: Experts classified 83096 individual observations (on the segment of the study July 2012 – October 2013). Over 89 % of the sample correspond to pulsars, twinkling springs and rapid radiotransmitters, and all other classes of observations belong to hardware failures, interference, the flight of the Earth satellite and aircraft. There were allocated 15 classes of observations.

Findings: Such a sample, divided into classes allows using the machine learning algorithms. It has become possible to develop an automated service for short-term/long-term monitoring of various classes of radio sources (including radiotransmitted of different nature), monitoring the Earth’s ionosphere, the interplanetary and the interstellar plasma, search and monitoring of different classes of radio sources. Monitoring in this case refers to the automatic filtering and detection of earlier unclassified impulse phenomena. Currently, for automatic filtering, statistical analysis methods are used. This paper considers an alternative method supposed to be using neural network machine learning algorithm which processes the input into raw data, and after processing by the hidden layer through the output layer determines the class of pulse phenomena.

Сonclusions: Creating a neural network model, trained on a sample and classifying earlier unclassified impulse phenomena, is performed using the cloud service Microsoft Azure Machine Learning Studio. The Web service, created based on the aforesaid model, allows classifying both single impulse phenomena in real time (Request / Reply) and data sampling for a certain period (Batch processing).

Key words: big data, deep neural networks, impulse phenomena classification

Manuscript submitted 20.10.2017

Radio phys. radio astron. 2017, 22(4): 270-275

REFERENCES

1. SAMODUROV, V. A., DUMSKY, D. V., ISAEV, E. A., RODIN, A. E., KAZANCEV A. N., FEDOROVA, V. A. and BELYATSKIJ, YU. A., 2016. The daily 110 MHz radio wave sky survey: statistical analysis of impulse phenomena from observation in 2012-2013. Odessa Astronomical Publications. vol. 29, pp. 167–170. DOI: https://doi.org/10.18524/1810-4215.2016.29.85206

 2. TAYLOR, G. B., ELLINGSON, S. W., KASSIM, N. E., CRAIG, J., DOWELL, J., WOLFE, C. N., HARTMAN, J., BERNARDI, G., CLARKE, T., COHEN, A., DALAL, N. P., ERICKSON, W. C., HICKS, B., GREENHILL, L. J., JACOBY, B., LANE, W., LAZIO, J., MITCHELL, D., NAVARRO, R., ORD, S. M., PIHLSTRÖM, Y., POLISENSKY, E., RAY, P. S., RICKARD, L. J., SCHINZEL, F. K., SCHMITT, H., SIGMAN, E., SORIANO, M., STEWART, K. P., STOVALL, K., TREMBLAY, S., WANG, D., WEILER, K. W., WHITE, S. and WOOD, D. L., 2012. First Light for the First Station of the Long Wavelength Array. J. Astron. Instrum. vol. 1, no. 1, id. 1250004. DOI: https://doi.org/10.1142/S2251171712500043

3. ROMAN, V. Ş. and BUIU, C., 2015. Automatic Analysis of Radio Meteor Events Using Neural Networks. Earth Moon Planets. vol. 116, is. 2, pp. 101–113. DOI: https://doi.org/10.1007/s11038-015-9473-y

 


Keywords


big data; deep neural networks; impulse phenomena classification

Full Text:

PDF


Creative Commons License
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND 4.0)