Аннотация: In their article the authors discuss ways to improve the performance of the enterprise by increasing the speed of access to data bases and overall system reliability. They study the characteristics of the data storage systems such as IOPS (the number of input-output operations per second), types of storage devices and how they connect. The authors also analyze specific scenarios of using data storate systems depending on their process connections and other basic characteristics as well as their application at the enterprise. The authors discuss further ways to expand the disk space and actions to be undertaken during when scaling of enterprise computing networks taking into account the emergence of new hybrid storage solutions based on flash memory. At the beginning of the article the authors discuss types of data storage and compares data storage sytems depending on enterprise objectives. They also study methods to select connections as well as advantages and disadvantages of each of them by studying the specifications and features of the software and hardware storage systems. The impact of IOPS on the speed of getting access to databases is also analyzed. The authors provide a table where characteristics of various data storage systems are compared. As a result of the work they identify specific patterns of using the storage system for small and medium-sized enterprises. This approach to the problem allows to create a flexible solution that does not require the complete replacement of the equipment by increasing the required disk space and connecting additional servers, thus improving the economic and process efficiency of the enterprise. 

Ключевые слова: fault tolerance, network storage, disk arrays, SSDs, hard disks, hypervisors, storage system, servers, client-server, scalability

Библиография:
Rybakova A.S., Ponachugin A.V. Informatsionnye tekhnologii: problemy ikh vnedreniya, dostoinstva, nedostatki // Aktual'nye problemy gumanitarnykh i estestvennykh nauk. 2014. № 11-2. S. 24-27.
Proskuryakov N.E., Anufrieva A.Yu. Analiz i perspektivy sovremennykh sistem khraneniya tsifrovykh dannykh // Izvestiya TulGU. Tekhnicheskie nauki. Vyp. 3: Tula: Izd-vo TulGU, 2013. S. 368-37.
Ponachugin A.V. Sozdanie i perspektivy otkrytykh apparatno-programmnykh sistem setevogo upravleniya tekhnologicheskimi protsessami // Informatsionnye tekhnologii v organizatsii edinogo obrazovatel'nogo prostranstva. Sbornik statey po materialam Mezhdunarodnoy nauchno-prakticheskoy konferentsii prepodavateley, studentov, aspirantov, soiskateley i spetsialistov. Kafedra Prikladnoy informatiki i informatsionnykh tekhnologiy v obrazovanii. Nizhniy Novgorod, 2015. S. 75-79.
Mazur E.M. Raspredelennye sistemy khraneniya dannykh: analiz, klassifikatsiya i vybor // Perspektivy razvitiya informatsionnykh tekhnologiy: sbornik materialov KhXVI Mezhdunarodnoy nauchno-prakticheskoy konferentsii / Pod obshch. red. S.S. Chernova. Novosibirsk: Izdatel'stvo TsRNS, 2015. S. 33-60.
Kuz'minskiy M. Evolyutsiya podsistemy vvoda-vyvoda meynfreymov IBM. // Otkrytye sistemy. 1999. Yanvar'. S. 16-27.
Gan'zha D. Set' ustroystv khraneniya // Zhurnal Setevykh Resheniy/LAN. 2001. № 2. S. 15-21.
Vasyaeva E.S., Sibiryakov M.A. Osobennosti razvitiya vysokoproizvoditel'nykh sistem khraneniya dannykh // sbornik tezisov VIII Mezhdunarodnoy molodezhnoy nauchnoy konferentsii» Nauchnomu progressu tvorchestvo molodykh (2013). S. 56.
Baykova I., Kulagin M. Sovremennye diskovye sistemy RAID // Otkrytye sistemy. 2012. № 3. S. 9-14.
Storage Security: Protecting, SANs, NAS and DAS (John Chirillo, et al, Wiley, ISBN# 0764516884), 2014. 55 p.
Storage Network Performance Analysis (Huseyin Simitci, Wiley, ISBN# 076451685X), 2011. 93 p.
Plank, J. S. The RAID Liberation codes // FAST-20012:6th Usenix Conference on File and Storage Technologies (San Jose, February 2012). 97 p.
Jacob Bruce, Ng Spencer W., Wang David T. Memory Systems Cache, Dram, Disk. Morgan Kaufmann Publishers, 2008. 982 p.
Plank J.S. A new minimum density RAID code with a word size of eight // NCA-08: 7th IEEE International Symposium on Network Computing Applications, Cambridge, MA, July 2011. 182 p.
Fibre Channel Consultant: A Comprehensive Introduction (Robert Kembel and Roger Cummings, Northwest Learning Assoc. Inc., ISBN# 0931836840), 2014. 37 p.
Fibre Channel Consultant: Arbitrated Loop (Robert Kembel and Horst Truestedt, McGraw Hill, ISBN# 0931836824), March 2011. 44 p.
IP SANS: An Introduction to iSCSI, iFCP, and FCIP Protocols for Storage Area Networks (Thomas Clark, Tom Clark, Addison-Wesley Professional, ISBN# 0201752778), 2015. 67 p.
Farley Marc. Building Storage Networks, second edition. The McGraw-Hill Companies, Inc., 2013. 596 p.
Designing Storage Area Networks: A Practical Reference for Implementing Fibre Channel and IP SANs, Second Edition (Tom Clark, Addison-Wesley Professional, ISBN# 0321136500), July 2011. 87 p.
Corbett P., English B., Goel A., Grcanac T., Kleiman S., Leong J., and Sankar, S. Row diagonal parity for double disk failure correction. //3rd Usenix Conference on File and Storage Technologies, San Francisco, CA, March 2014. 133 p.
Blaum M., Brady J., Bruck J., and Menon J. Evenodd: An efficient scheme for tolerating double disk failures in RAID architectures // IEEE Transactions on Computing 44, 2 February 2011. 192 p.
Sibiryakov M.A., Vasyaeva E.S. Sravnitel'nyy analiz osnovnykh modeley intellektual'nykh sistem khraneniya dannykh v protsesse ikh evolyutsii //Informatsionnye tekhnologii v professional'noy deyatel'nosti i nauchnoy rabote. 2012. Ch 1. S. 99-105.
Sibiryakov M.A. Sposoby povysheniya proizvoditel'nosti sistem khraneniya dannykh // Elektronnyy nauchnyy zhurnal Instituta programmnykh sistem imeni A.K. Aylamazyana Rossiyskoy akademii nauk, 2015. S. 1-3.

References (transliteration):
Rybakova A.S., Ponachugin A.V. Informatsionnye tekhnologii: problemy ikh vnedreniya, dostoinstva, nedostatki // Aktual'nye problemy gumanitarnykh i estestvennykh nauk. 2014. № 11-2. S. 24-27.
Proskuryakov N.E., Anufrieva A.Yu. Analiz i perspektivy sovremennykh sistem khraneniya tsifrovykh dannykh // Izvestiya TulGU. Tekhnicheskie nauki. Vyp. 3: Tula: Izd-vo TulGU, 2013. S. 368-37.
Ponachugin A.V. Sozdanie i perspektivy otkrytykh apparatno-programmnykh sistem setevogo upravleniya tekhnologicheskimi protsessami // Informatsionnye tekhnologii v organizatsii edinogo obrazovatel'nogo prostranstva. Sbornik statey po materialam Mezhdunarodnoy nauchno-prakticheskoy konferentsii prepodavateley, studentov, aspirantov, soiskateley i spetsialistov. Kafedra Prikladnoy informatiki i informatsionnykh tekhnologiy v obrazovanii. Nizhniy Novgorod, 2015. S. 75-79.
Mazur E.M. Raspredelennye sistemy khraneniya dannykh: analiz, klassifikatsiya i vybor // Perspektivy razvitiya informatsionnykh tekhnologiy: sbornik materialov KhXVI Mezhdunarodnoy nauchno-prakticheskoy konferentsii / Pod obshch. red. S.S. Chernova. Novosibirsk: Izdatel'stvo TsRNS, 2015. S. 33-60.
Kuz'minskiy M. Evolyutsiya podsistemy vvoda-vyvoda meynfreymov IBM. // Otkrytye sistemy. 1999. Yanvar'. S. 16-27.
Gan'zha D. Set' ustroystv khraneniya // Zhurnal Setevykh Resheniy/LAN. 2001. № 2. S. 15-21.
Vasyaeva E.S., Sibiryakov M.A. Osobennosti razvitiya vysokoproizvoditel'nykh sistem khraneniya dannykh // sbornik tezisov VIII Mezhdunarodnoy molodezhnoy nauchnoy konferentsii» Nauchnomu progressu tvorchestvo molodykh (2013). S. 56.
Baykova I., Kulagin M. Sovremennye diskovye sistemy RAID // Otkrytye sistemy. 2012. № 3. S. 9-14.
Storage Security: Protecting, SANs, NAS and DAS (John Chirillo, et al, Wiley, ISBN# 0764516884), 2014. 55 p.
Storage Network Performance Analysis (Huseyin Simitci, Wiley, ISBN# 076451685X), 2011. 93 p.
Plank, J. S. The RAID Liberation codes // FAST-20012:6th Usenix Conference on File and Storage Technologies (San Jose, February 2012). 97 p.
Jacob Bruce, Ng Spencer W., Wang David T. Memory Systems Cache, Dram, Disk. Morgan Kaufmann Publishers, 2008. 982 p.
Plank J.S. A new minimum density RAID code with a word size of eight // NCA-08: 7th IEEE International Symposium on Network Computing Applications, Cambridge, MA, July 2011. 182 p.
Fibre Channel Consultant: A Comprehensive Introduction (Robert Kembel and Roger Cummings, Northwest Learning Assoc. Inc., ISBN# 0931836840), 2014. 37 p.
Fibre Channel Consultant: Arbitrated Loop (Robert Kembel and Horst Truestedt, McGraw Hill, ISBN# 0931836824), March 2011. 44 p.
IP SANS: An Introduction to iSCSI, iFCP, and FCIP Protocols for Storage Area Networks (Thomas Clark, Tom Clark, Addison-Wesley Professional, ISBN# 0201752778), 2015. 67 p.
Farley Marc. Building Storage Networks, second edition. The McGraw-Hill Companies, Inc., 2013. 596 p.
Designing Storage Area Networks: A Practical Reference for Implementing Fibre Channel and IP SANs, Second Edition (Tom Clark, Addison-Wesley Professional, ISBN# 0321136500), July 2011. 87 p.
Corbett P., English B., Goel A., Grcanac T., Kleiman S., Leong J., and Sankar, S. Row diagonal parity for double disk failure correction. //3rd Usenix Conference on File and Storage Technologies, San Francisco, CA, March 2014. 133 p.
Blaum M., Brady J., Bruck J., and Menon J. Evenodd: An efficient scheme for tolerating double disk failures in RAID architectures // IEEE Transactions on Computing 44, 2 February 2011. 192 p.
Sibiryakov M.A., Vasyaeva E.S. Sravnitel'nyy analiz osnovnykh modeley intellektual'nykh sistem khraneniya dannykh v protsesse ikh evolyutsii //Informatsionnye tekhnologii v professional'noy deyatel'nosti i nauchnoy rabote. 2012. Ch 1. S. 99-105.
Sibiryakov M.A. Sposoby povysheniya proizvoditel'nosti sistem khraneniya dannykh // Elektronnyy nauchnyy zhurnal Instituta programmnykh sistem imeni A.K. Aylamazyana Rossiyskoy akademii nauk, 2015. S. 1-3.

Аннотация: CMD-3 – a particle detector, running on electron-positron collider VEPP-2000 in the Budker Institute of Nuclear Physics. In order to ensure the final quality control of recorded data and diagnosis of faults in the subsystems of a detector a full reconstruction of events is performed by software developed by CMD-3 collaboration. Depending on the luminosity of the collider up to 1500 events per second can be detected, which is 30 times higher than the average speed of its processing by a single process. In order to improve the efficiency of data collection and detector system as a whole, the speed of reconstruction was increased using multiple distribution processing processes to keep up with the values arising at peak luminosity. The article provides an overview of systems for data collection and processing of the detector and also describes the architecture of a distributed version of the software reconstruction of the events recorded by the detector. To find the best architectural solution methods of system analysis and structural decomposition components of data collection and processing systems were used, resulting in a proposed solution that implements a pattern of "pipes and filters". A methodology of imperative parallel programming has been applied. Modules for the transfer of necessary data processing between processes were added to the application. The implemented system can handle events with the speed of recording, which provides information on the integral characteristics of the complex, and allows responding to malfunctions in the electronics and software of the detector in real time.

Ключевые слова: reconstruction of the events of the detector, rapid analysis, accelerating complex , data analysis, distributed system, increasing the speed of data processing, CMD-3 , distributed processing, data processing, quality control

Библиография:
Institut Yadernoy Fiziki im. G.I.Budkera. URL: http://www.inp.nsk.su.
Bennett G.W., Bousquet B., Brown H., Bunce G., Carey R., Cushman P., Danby G., Debevec P., Deile M., Deng H. Final report of the E821 muon anomalous magnetic moment measurement at BNL // Physical Review D. 2006. T. 73. № 7. — C. 072003.
Berkaev D., Kirpotin A., Koop I., Lysenko A., Nesterenko I., Otboyev A., Perevedentsev E., Rogovsky Y., Romanov A., Shatunov P. VEPP-2000 operation with round beams in the energy range from 1 to 2 GeV // Nuclear Physics B-Proceedings Supplements. 2012. T. 225. — C. 303-308.
Shatunov Y.M., Evstigneev A., Ganyushin D., Ivanov P., Koop I., Kuzminykh V., Lysenko A., Mezentsev N., Mityanina N., Nesterenko I. Project of a new electron-positron collider VEPP-2000. 2000. — 439-441.
Aul'chenko V., Aksenov V., Beschastnov P. SND–Sfericheskiy Neytral'nyy Detektor dlya VEPP-2M // Preprint IYaF. — C. 87-36.
Khazin B. Physics and Detectors for VEPP-2000 // Nuclear Physics B-Proceedings Supplements. 2008. T. 181. — C. 376-380.
Gaiazov S., Banzarov V., Ignatov F., Logashenko I., Pirogov S., Sukharev A., Zaytsev A. Distributed data analysis system for CMD-3 detector // Journal of Instrumentation. 2014. T. 9. № 08. — C. C08011.
Ritt S., Armaudruz P., Olchanski K. MIDAS (Maximum Integration Data Acquisition System) // URL https://midas. psi. ch. 2001.
Hayes S., Cabrero K. Generalised and Advanced Urban Debiting Innovations: THE GAUDI PROJECT. 1. OVERVIEW // Traffic engineering & control. 1995. T. 36. № 1.
Anisenkov A., Ignatov F., Pirogov S., Sibidanov A., Viduk S., Zaytsev A. CMD-3 detector offline software development. : IOP Publishing, 2010. — 032027.
Brun R., Rademakers F. ROOT—an object oriented data analysis framework // Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. 1997. T. 389. № 1. — C. 81-86.
Gabriel E., Fagg G.E., Bosilca G., Angskun T., Dongarra J.J., Squyres J.M., Sahay V., Kambadur P., Barrett B., Lumsdaine A. Open MPI: Goals, concept, and design of a next generation MPI implementation // Recent Advances in Parallel Virtual Machine and Message Passing Interface : Springer, 2004. — C. 97-104.
Gropp W., Lusk E., Doss N., Skjellum A. A high-performance, portable implementation of the MPI message passing interface standard // Parallel computing. 1996. T. 22. № 6. — C. 789-828.
Fineberg S. MPIRUN: A loader for multidisciplinary and multizonal MPI applications // NAS News. 1994. T. 2. № 6. — C. 102.

References (transliteration):
Institut Yadernoy Fiziki im. G.I.Budkera. URL: http://www.inp.nsk.su.
Bennett G.W., Bousquet B., Brown H., Bunce G., Carey R., Cushman P., Danby G., Debevec P., Deile M., Deng H. Final report of the E821 muon anomalous magnetic moment measurement at BNL // Physical Review D. 2006. T. 73. № 7. — C. 072003.
Berkaev D., Kirpotin A., Koop I., Lysenko A., Nesterenko I., Otboyev A., Perevedentsev E., Rogovsky Y., Romanov A., Shatunov P. VEPP-2000 operation with round beams in the energy range from 1 to 2 GeV // Nuclear Physics B-Proceedings Supplements. 2012. T. 225. — C. 303-308.
Shatunov Y.M., Evstigneev A., Ganyushin D., Ivanov P., Koop I., Kuzminykh V., Lysenko A., Mezentsev N., Mityanina N., Nesterenko I. Project of a new electron-positron collider VEPP-2000. 2000. — 439-441.
Aul'chenko V., Aksenov V., Beschastnov P. SND–Sfericheskiy Neytral'nyy Detektor dlya VEPP-2M // Preprint IYaF. — C. 87-36.
Khazin B. Physics and Detectors for VEPP-2000 // Nuclear Physics B-Proceedings Supplements. 2008. T. 181. — C. 376-380.
Gaiazov S., Banzarov V., Ignatov F., Logashenko I., Pirogov S., Sukharev A., Zaytsev A. Distributed data analysis system for CMD-3 detector // Journal of Instrumentation. 2014. T. 9. № 08. — C. C08011.
Ritt S., Armaudruz P., Olchanski K. MIDAS (Maximum Integration Data Acquisition System) // URL https://midas. psi. ch. 2001.
Hayes S., Cabrero K. Generalised and Advanced Urban Debiting Innovations: THE GAUDI PROJECT. 1. OVERVIEW // Traffic engineering & control. 1995. T. 36. № 1.
Anisenkov A., Ignatov F., Pirogov S., Sibidanov A., Viduk S., Zaytsev A. CMD-3 detector offline software development. : IOP Publishing, 2010. — 032027.
Brun R., Rademakers F. ROOT—an object oriented data analysis framework // Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. 1997. T. 389. № 1. — C. 81-86.
Gabriel E., Fagg G.E., Bosilca G., Angskun T., Dongarra J.J., Squyres J.M., Sahay V., Kambadur P., Barrett B., Lumsdaine A. Open MPI: Goals, concept, and design of a next generation MPI implementation // Recent Advances in Parallel Virtual Machine and Message Passing Interface : Springer, 2004. — C. 97-104.
Gropp W., Lusk E., Doss N., Skjellum A. A high-performance, portable implementation of the MPI message passing interface standard // Parallel computing. 1996. T. 22. № 6. — C. 789-828.
Fineberg S. MPIRUN: A loader for multidisciplinary and multizonal MPI applications // NAS News. 1994. T. 2. № 6. — C. 102.

Аннотация: In the middle of the last century the problem of functioning and maintenance reliability has acquired the status of scientific. This was facilitated by the active development of computer systems. Implementation and support of information systems are long, difficult and complicated processes, which affect how the future interactions between users and the system. The article discusses various approaches to the allocation and use of time required for supporting information system. Author analyzes the importance of supporting information system at all stages of its life cycle. Author reviews different approaches to ensuring the reliability of the operation and maintenance of the various classes of information systems. The article gives a defined list of recommendations for ensuring functioning of the information system at different levels of management. The study shows an analysis of existing software and hardware tools and methods related to maintenance and reliable functioning of information systems. The author concludes: the maintenance of computer systems is equally important at all stages of the life cycle and occupies a considerable share of time in the work of the information technology department and is inextricably linked with the indicators of reliability of information systems. Also, the author suggests the technique of the use of software tools for the control of characteristics of information system.

Ключевые слова: durability, life cycle, reliability, soft agents, support of information system, computer systems, infallibility, obsolescence of the information system, design of information systems, automated control systems

Библиография:
Peter Tandler (2001), Software Infrastructure for Ubiquitous Computing Environments Supporting Synchronous Collaboration with Multiple Single-and Multi-User Device, Proceedings of UBICOMP Lecture Notes in Computer Science, Heidelberg: Springer.
Janaki Ram D. and Raju S.V.G.K. (2000), Object Oriented Software with Predictive Ob-jective Points, Proceeding of First Asia Pacific Conference on Quality Software, pp. 121-126.
Fenton N.E. and Ohlsson N. (2000), Quantitative Analysis of Faults and Failures in a Complex Software System, IEEE Transactions on Software Engineering, to appear, Vol. 26, № 8, pp. 797-814.
Sennik Yu.S. Zhiznennyy tsikl informatsionnykh sistem / Yu.S. Sennik, I.R. Grebennikov // Sistemnyy analiz i prikladnaya informatika. 2015. № 2. S. 4-9.
Boehm B.W. and Others (2000), Software Cost Estimation with COCOMO IF, Prentice Hall PTR, ISBN: 0130266922.
Devet'yarova I. Trudno byt' Bogom. Problemy soprovozhdeniya i razvitiya infor-matsionnoy sistemy torgovogo predpriyatiya [Elektronnyy resurs]-URL: http://www.domino.ru/-to-interesno/trudno-byit--bogom.html (data obrashcheniya: 23.01.2016).
Guliev Ya.I., Babayan M.A., Fokht O.A. Vnedrenie i soprovozhdenie korporativnoy informatsionnoy sistemy. Obespechenie obratnoy svyazi // Tr. mezhdunar. konf. «Programm-nye sistemy: teoriya i prilozheniya», IPS RAN, Pereslavl'-Zalesskiy, 2004: V 2 t. / Pod red. S.M. Abramova. M.: Fizmatlit. T. 2. S. 271.
Aksel' Ivanovich Berg. 1893-1979 / red.-sost. Ya.I. Fet; sost.: E.V. Markova, Yu.N. Erofeev, Yu.V. Granovskiy; otv. red. A.S. Alekseev. M.: Nauka, 2007. 518 s.
Braude E. Tekhnologiya razrabotki programmnogo obespecheniya. SPb.: Piter, 2004. 655 s.: il.

References (transliteration):
Peter Tandler (2001), Software Infrastructure for Ubiquitous Computing Environments Supporting Synchronous Collaboration with Multiple Single-and Multi-User Device, Proceedings of UBICOMP Lecture Notes in Computer Science, Heidelberg: Springer.
Janaki Ram D. and Raju S.V.G.K. (2000), Object Oriented Software with Predictive Ob-jective Points, Proceeding of First Asia Pacific Conference on Quality Software, pp. 121-126.
Fenton N.E. and Ohlsson N. (2000), Quantitative Analysis of Faults and Failures in a Complex Software System, IEEE Transactions on Software Engineering, to appear, Vol. 26, № 8, pp. 797-814.
Sennik Yu.S. Zhiznennyy tsikl informatsionnykh sistem / Yu.S. Sennik, I.R. Grebennikov // Sistemnyy analiz i prikladnaya informatika. 2015. № 2. S. 4-9.
Boehm B.W. and Others (2000), Software Cost Estimation with COCOMO IF, Prentice Hall PTR, ISBN: 0130266922.
Devet'yarova I. Trudno byt' Bogom. Problemy soprovozhdeniya i razvitiya infor-matsionnoy sistemy torgovogo predpriyatiya [Elektronnyy resurs]-URL: http://www.domino.ru/-to-interesno/trudno-byit--bogom.html (data obrashcheniya: 23.01.2016).
Guliev Ya.I., Babayan M.A., Fokht O.A. Vnedrenie i soprovozhdenie korporativnoy informatsionnoy sistemy. Obespechenie obratnoy svyazi // Tr. mezhdunar. konf. «Programm-nye sistemy: teoriya i prilozheniya», IPS RAN, Pereslavl'-Zalesskiy, 2004: V 2 t. / Pod red. S.M. Abramova. M.: Fizmatlit. T. 2. S. 271.
Aksel' Ivanovich Berg. 1893-1979 / red.-sost. Ya.I. Fet; sost.: E.V. Markova, Yu.N. Erofeev, Yu.V. Granovskiy; otv. red. A.S. Alekseev. M.: Nauka, 2007. 518 s.
Braude E. Tekhnologiya razrabotki programmnogo obespecheniya. SPb.: Piter, 2004. 655 s.: il.

Аннотация: The article considers the prevailing contradictions between the nature of the vulnerabilities in source code, safety requirements limitations of regulatory and methodological basis of tests and software developers who do not provide the source code for testing purposes. Methods of software products analysis that do not require the source code of programs, are widely used abroad but in our country are not well known yet. The article investigates the question can such methods and means increase the effectiveness of certification testing of software. The authors determine the necessary changes in the regulations to open up the possibility of applying the methods of testing programs without source code in the certification tests. Methods used in the study: software engineering, analysis of complex systems, the theory of reliability of complex systems, the synthesis software, compiling software. The paper shows that the use of methods for testing without source code allows to find such common vulnerabilities in the software that can’t be effectively detected because of the regulatory restrictions for the presence of source code. The experience of certification tests on the absence of undeclared features and program bookmarks, as well as independent software testing allows to determine the priority areas for improvement of the regulatory, based on the application of the methods of testing software without source code.

Ключевые слова: evaluation of data protection, software security, detection of undeclared features, detection of software bookmarks, software testing, software certification, software vulnerability, identification of vulnerable programs, signature analysis, testing programs

Библиография:
Golosovskiy M.S. Model' zhiznennogo tsikla razrabotki programmnogo obespecheniya v ramkakh nauchno-issledovatel'skikh rabot//Avtomatizatsiya i sovremennye tekhnologii. 2014. № 1. S. 43-46.
Markov A.S., Mironov S.V., Tsirlov V.L. Opyt testirovaniya setevykh skanerov uyazvimostey // Informatsionnoe protivodeystvie ugrozam terrorizma. 2005. № 5. S. 109-122.
Nashchekin P.A., Nepomnyashchikh A.V., Sosnin Yu.V., Kulikov G.V. Kriterii i metody proverki vypolneniya trebovaniy po zashchishchennosti avtomatizirovannoy sistemy pri izmenenii nastroek ili vydelennykh resursov sredstv zashchity informatsii // Voprosy zashchity informatsii. 2013. № 4 (102). S. 50-53.
Zakonodatel'no-pravovoe i organizatsionno-tekhnicheskoe obespechenie informatsionnoy bezopasnosti AS i IVS / Pod red. I.V.Kotenko. SPb: VUS, 2000. 190 s.
Markov A.S., Mironov S.V., Tsirlov V.L. Vyyavlenie uyazvimostey programmnogo obespecheniya v protsesse sertifikatsii // Informatsionnoe protivodeystvie ugrozam terrorizma. 2006. № 7. S. 177-186.
Bogomolov A.V., Chuykov D.S., Zaporozhskiy Yu.A. Sredstva obespecheniya bezopasnosti informatsii v sovremennykh avtomatizirovannykh sistemakh//Informatsionnye tekhnologii. 2003. № 1. S.2-8.
Nepomnyashchikh A.V., Kulikov G.V., Sosnin Yu.V., Nashchekin P.A. Metody otsenivaniya zashchishchennosti informatsii v avtomatizirovannykh sistemakh ot nesanktsionirovannogo dostupa // Voprosy zashchity informatsii. 2014. № 1 (104). S. 3-12.
Rukovodyashchiy dokument Gostekhkomissii Rossii «Zashchita ot nesanktsionirovannogo dostupa k informatsii. Chast' 1. Programmnoe obespechenie sredstv zashchity informatsii. Klassifikatsiya po urovnyu kontrolya otsutstviya nedeklarirovannykh vozmozhnostey» 1999. 122 s.
Fedorov M.V., Kalinin K.M., Bogomolov A.V., Stetsyuk A.N. Matematicheskaya model' avtomatizirovannogo kontrolya vypolneniya meropriyatiy v organakh voennogo upravleniya // Informatsionno-izmeritel'nye i upravlyayushchie sistemy. 2011. T. 9. № 5. S. 46-54.
Sosnin Yu.V., Kulikov G.V., Nepomnyashchikh A.V. Kompleks matematicheskikh modeley optimizatsii konfiguratsii sredstv zashchity informatsii ot nesanktsionirovannogo dostupa // Programmnye sistemy i vychislitel'nye metody. 2015. № 1. S. 32-44.
Markov A.S., Mironov S.V., Tsirlov V.L.. Vyyavlenie uyazvimostey v programmnom kode // Otkrytye sistemy, №12, 2005. S.64-69.
Markov A.S., Mironov S.V., Tsirlov V.L. Razrabotka politiki bezopasnosti organizatsii v svete noveyshey normativnoy bazy // Zashchita informatsii. Konfident. 2004. № 2. S. 20.
Khovard M., LeBlank D., Viera D. 19 smertnykh grekhov, ugrozhayushchikh bezopasnosti programm: kak nedopustit' tipichnykh oshibok. M.: Izdatel'skiy Dom «DMK-press», 2006. 442 s.
Mayers G. Iskusstvo testirovaniya programm. M.: Finansy i statistika, 1982. 162 s.
Lakutin A. Autsorsing testirovaniya programmnogo obespecheniya. M.: KIS, 2002. 412 s.
Golosovskiy M.S. Informatsionno-logicheskaya model' protsessa razrabotki programmnogo obespecheniya // Programmnye sistemy i vychislitel'nye metody. 2015. № 1. S. 59-68.
Standard for Software Unit Testing. ANSI/IEEE Std 1008-1987. 31 r.
Kotlyarov V.P., Kolikova T.V. Osnovy testirovaniya programmnogo obespecheniya. M.: Internet-universitet informatsionnykh tekhnologiy, 2006. 285 s.
Kozlov V.E., Bogomolov A.V., Rudakov S.V., Olenchenko V.T. Matematicheskoe obespechenie obrabotki reytingovoy informatsii v zadachakh ekspertnogo otsenivaniya//Mir izmereniy. 2012. № 9. S. 42-49.
Kukushkin Yu.A., Bogomolov A.V., Ushakov I.B. Matematicheskoe obespechenie otsenivaniya sostoyaniya material'nykh sistem//Informatsionnye tekhnologii. 2004. Prilozhenie k № 7. 24 s.
Beyzer B. Testirovanie chernogo yashchika: tekhnologii funktsional'nogo testirovaniya programmnogo obespecheniya sistem. SPb.: Piter, 2004. 236 s

References (transliteration):
Golosovskiy M.S. Model' zhiznennogo tsikla razrabotki programmnogo obespecheniya v ramkakh nauchno-issledovatel'skikh rabot//Avtomatizatsiya i sovremennye tekhnologii. 2014. № 1. S. 43-46.
Markov A.S., Mironov S.V., Tsirlov V.L. Opyt testirovaniya setevykh skanerov uyazvimostey // Informatsionnoe protivodeystvie ugrozam terrorizma. 2005. № 5. S. 109-122.
Nashchekin P.A., Nepomnyashchikh A.V., Sosnin Yu.V., Kulikov G.V. Kriterii i metody proverki vypolneniya trebovaniy po zashchishchennosti avtomatizirovannoy sistemy pri izmenenii nastroek ili vydelennykh resursov sredstv zashchity informatsii // Voprosy zashchity informatsii. 2013. № 4 (102). S. 50-53.
Zakonodatel'no-pravovoe i organizatsionno-tekhnicheskoe obespechenie informatsionnoy bezopasnosti AS i IVS / Pod red. I.V.Kotenko. SPb: VUS, 2000. 190 s.
Markov A.S., Mironov S.V., Tsirlov V.L. Vyyavlenie uyazvimostey programmnogo obespecheniya v protsesse sertifikatsii // Informatsionnoe protivodeystvie ugrozam terrorizma. 2006. № 7. S. 177-186.
Bogomolov A.V., Chuykov D.S., Zaporozhskiy Yu.A. Sredstva obespecheniya bezopasnosti informatsii v sovremennykh avtomatizirovannykh sistemakh//Informatsionnye tekhnologii. 2003. № 1. S.2-8.
Nepomnyashchikh A.V., Kulikov G.V., Sosnin Yu.V., Nashchekin P.A. Metody otsenivaniya zashchishchennosti informatsii v avtomatizirovannykh sistemakh ot nesanktsionirovannogo dostupa // Voprosy zashchity informatsii. 2014. № 1 (104). S. 3-12.
Rukovodyashchiy dokument Gostekhkomissii Rossii «Zashchita ot nesanktsionirovannogo dostupa k informatsii. Chast' 1. Programmnoe obespechenie sredstv zashchity informatsii. Klassifikatsiya po urovnyu kontrolya otsutstviya nedeklarirovannykh vozmozhnostey» 1999. 122 s.
Fedorov M.V., Kalinin K.M., Bogomolov A.V., Stetsyuk A.N. Matematicheskaya model' avtomatizirovannogo kontrolya vypolneniya meropriyatiy v organakh voennogo upravleniya // Informatsionno-izmeritel'nye i upravlyayushchie sistemy. 2011. T. 9. № 5. S. 46-54.
Sosnin Yu.V., Kulikov G.V., Nepomnyashchikh A.V. Kompleks matematicheskikh modeley optimizatsii konfiguratsii sredstv zashchity informatsii ot nesanktsionirovannogo dostupa // Programmnye sistemy i vychislitel'nye metody. 2015. № 1. S. 32-44.
Markov A.S., Mironov S.V., Tsirlov V.L.. Vyyavlenie uyazvimostey v programmnom kode // Otkrytye sistemy, №12, 2005. S.64-69.
Markov A.S., Mironov S.V., Tsirlov V.L. Razrabotka politiki bezopasnosti organizatsii v svete noveyshey normativnoy bazy // Zashchita informatsii. Konfident. 2004. № 2. S. 20.
Khovard M., LeBlank D., Viera D. 19 smertnykh grekhov, ugrozhayushchikh bezopasnosti programm: kak nedopustit' tipichnykh oshibok. M.: Izdatel'skiy Dom «DMK-press», 2006. 442 s.
Mayers G. Iskusstvo testirovaniya programm. M.: Finansy i statistika, 1982. 162 s.
Lakutin A. Autsorsing testirovaniya programmnogo obespecheniya. M.: KIS, 2002. 412 s.
Golosovskiy M.S. Informatsionno-logicheskaya model' protsessa razrabotki programmnogo obespecheniya // Programmnye sistemy i vychislitel'nye metody. 2015. № 1. S. 59-68.
Standard for Software Unit Testing. ANSI/IEEE Std 1008-1987. 31 r.
Kotlyarov V.P., Kolikova T.V. Osnovy testirovaniya programmnogo obespecheniya. M.: Internet-universitet informatsionnykh tekhnologiy, 2006. 285 s.
Kozlov V.E., Bogomolov A.V., Rudakov S.V., Olenchenko V.T. Matematicheskoe obespechenie obrabotki reytingovoy informatsii v zadachakh ekspertnogo otsenivaniya//Mir izmereniy. 2012. № 9. S. 42-49.
Kukushkin Yu.A., Bogomolov A.V., Ushakov I.B. Matematicheskoe obespechenie otsenivaniya sostoyaniya material'nykh sistem//Informatsionnye tekhnologii. 2004. Prilozhenie k № 7. 24 s.
Beyzer B. Testirovanie chernogo yashchika: tekhnologii funktsional'nogo testirovaniya programmnogo obespecheniya sistem. SPb.: Piter, 2004. 236 s

Аннотация: on the sample application for measuring characteristics of electric transport the authors discuss debugging and logging in integrated programming environment Eclipse IDE used for mobile software development under Android operating system. The article reviews a practical example of classical black box testing approach for the mentioned Android application. The authors show results of a brief study of the existing Android-specific information about the ways and practical use of reporting an error to the developer directly. The experimentally obtained data, a study during software development (getting an incorrect result followed by testing, correcting input data and code, and, as a result, developing workable software). The article shows specific methods of software testing, applicable only to software for Android OS, as well as for software, receiving and processing data from sensors electric in transport. As a result, the article reviews debugging, logging, white and black box testing, sending bug reports. The authors also present samples of data that can be used for validation of the performance of various parts of the program for displaying the characteristics of the electric vehicles.

Ключевые слова: testing, Android OS, Eclipse IDE, characteristics of electric transport, application, black box, white box, mobile devices, debugging, bug reports

Библиография:
Brayan Khardi, Bill Fillips. Programmirovanie pod Android. Dlya professionalov. SPb.: Piter, 2014. 592 s.
Klimov A. Otladka // Osvoy programmirovanie igrayuchi. 2014. URL: http://developer.alexanderklimov.ru/android/theory/debug.php (data obrashcheniya: 17.06.14)
Google Inc. Android API Reference // Android Developers. 2014. URL: http://developer.android.com/reference/android/util/Log.html (data obrashcheniya: 17.06.14)
Stepanchenko I. V. Metody testirovaniya programmnogo obespecheniya: Ucheb. posobie. Volgograd: VolgGTU, 2006. 74 s.
Google Inc. Sboi i oshibki ANR (“Prilozhenie ne otvechaet”) // Google Support. 2014. URL: https://support.google.com/googleplay/android-developer/answer/6083203#export_crashes_and_anrs (data obrashcheniya: 04.07.14)

References (transliteration):
Brayan Khardi, Bill Fillips. Programmirovanie pod Android. Dlya professionalov. SPb.: Piter, 2014. 592 s.
Klimov A. Otladka // Osvoy programmirovanie igrayuchi. 2014. URL: http://developer.alexanderklimov.ru/android/theory/debug.php (data obrashcheniya: 17.06.14)
Google Inc. Android API Reference // Android Developers. 2014. URL: http://developer.android.com/reference/android/util/Log.html (data obrashcheniya: 17.06.14)
Stepanchenko I. V. Metody testirovaniya programmnogo obespecheniya: Ucheb. posobie. Volgograd: VolgGTU, 2006. 74 s.
Google Inc. Sboi i oshibki ANR (“Prilozhenie ne otvechaet”) // Google Support. 2014. URL: https://support.google.com/googleplay/android-developer/answer/6083203#export_crashes_and_anrs (data obrashcheniya: 04.07.14)

Аннотация: the article studies methods of determining functional completeness of automated information systems implemented in state social institutions. The author defines a list of automated functions, directly affecting the efficiency of the institution. The article reviews the use of technique based on the Delphi method in expert evaluation. The author considers features of the above mentioned technique as well as Spearman’s rank correlation coefficient for the convergence of expert evaluations. The application of the method is demonstrated on the example of eight different software products for automation of services provisioning by public social institutions. For the first time the article proposes the use of technique based on the Delphi method in expert evaluation with the Spearman’s rank correlation coefficient for the convergence of expert evaluations for evaluating the quality and functional completeness of automated information systems implemented in state social institutions. The analysis described in the article proves that appliance of the technique mentioned above significantly increases the objectiveness of the evaluation, through the use of feedback, analysis of the results of previous stages, as well as their account when estimating the significance of expert opinion.

Ключевые слова: functional completeness, expert evaluation, information systems, Delphi method, Spearman coefficient, methods of peer review, the convergence of expert evaluations, the pair correlation coefficient, coefficient of concordance, Kendall coefficient

Контактная информация: Boikov Sergei Aleksandrovich, 410003, Russia, Saratov, ul. Radishcheva, 89

Библиография:
1. Litvak B.G. Ekspertnye tekhnologii v upravlenii: Ucheb. Posobie.-M.: Delo, 2004.-400 S.
2. Orlov A.I. Ekspertnye otsenki. Uchebnoe posobie.-M.: 2002.-31 S.
3. Khubaev G.N. Poluchenie gruppovoy ekspertnoy otsenki znacheniy pokazateley: poshagovaya protsedura i
programmnoe obespechenie // Programmnye produkty i sistemy.-2011.-№2.-S. 2-8.
4. Khubaev G.N. Slozhnye sistemy: ekspertnye metody sravneniya // Izv. vuzov. Severo-Kavkazskiy region.
Obshchestvennye nauki. 1999. № 3. S. 7-24.

References (transliteration):
1. Litvak B.G. Ekspertnye tekhnologii v upravlenii: Ucheb. Posobie.-M.: Delo, 2004.-400 S.
2. Orlov A.I. Ekspertnye otsenki. Uchebnoe posobie.-M.: 2002.-31 S.
3. Khubaev G.N. Poluchenie gruppovoy ekspertnoy otsenki znacheniy pokazateley: poshagovaya protsedura i
programmnoe obespechenie // Programmnye produkty i sistemy.-2011.-№2.-S. 2-8.
4. Khubaev G.N. Slozhnye sistemy: ekspertnye metody sravneniya // Izv. vuzov. Severo-Kavkazskiy region.
Obshchestvennye nauki. 1999. № 3. S. 7-24.