Lymphocyte apoptosis and immune response in patients with drug-resistant fibro-cavernous tuberculosis with different prevalence of destructive changes in the lungs
https://doi.org/10.15789/1563-0625-2019-6-1099-1114
Abstract
Disturbances of programmed cell death are at the heart of many immunopathological processes in tuberculosis. The relationship between activity of apoptosis and severity of immune response is of particular interest in the patients with fibrous-cavernous drug-resistant pulmonary tuberculosis at different extent of the process. The paper concerns features of apoptosis, proliferative activity of lymphocytes, cytokine’s production and subpopulation composition of peripheral blood lymphocytes in the patients with uni- and bilateral fibrous-cavernous drug-resistant pulmonary tuberculosis. It was shown that apoptotic rates in the examined patients is closely related to extent of pathological process. Extent of early and late apoptosis and, accordingly, the number of living cells reflected the progression degree of destructive process in the lungs affected by fibrous-cavernous tuberculosis. The possibility of predicting the extent of destructive changes in affected lungs based on expression of apoptosis markers is presumed. Index of activity for early apoptosis of T lymphocytes, exceeding normal values by 25% and higher were clinically significant. A clear relationship between the immune response and apoptosis level was revealed. Ambiguous changes of immunological parameters were shown with increasing apoptosis associated with the severity of destructive changes. Increased apoptotic cell death in all patients with fibrous-cavernous tuberculosis, regardless of extent of the process, was associated with inhibition of antigen-specific proliferative response, decrease in CD25+ lymphocytes, increased numbers of B cells, along with decreased production of IFNγ, IL-8, and increased IL-2 response to PPD. In cases of unilateral destruction, increased apoptotic rates were accompanied by a decrease in the CD95+ cell numbers, and a decrease in TNFα production. On the contrary, in patients with bilateral destruction it was characterized by a high content of CD95+ lymphocytes, increased production of TNFα and IL-10. An index of extremely unfavorable course of the process is a combination of high apoptosis levels and low antigen-specific response with low expression of CD25+ cells, increased number of CD19+ and CD95+ lymphocytes, decreased production of IFNγ, IL-8 and increased production of IL-2, TNFα, IL-10. The relationships found in the work indicate that the combined assessment of apoptosis indexes, together with immunological parameters, has a higher informative value when assessing the state of immunocompetent cells, the origin of the process and trends for its development. Detecting the features of programmed lymphocyte death, in conjunction with immune parameters, allows to evaluate the role of apoptosis in each single case and to predict the course of the process, with subsequent justification of immunotherapy administration.
About the Authors
B. E. KnoringSaint-Petersburg State Research Institute of Phthisiopulmonology of the Ministry of Healthcare of the Russian Federation
Russian Federation
Knoring Beatrice Efimovna - PhD, MD (Medicine), Professor, Research Consultant, Department of Laboratory Diagnostics
Competing Interests: not
N. I. Davydova
A.M. Nikiforov Russian Centre for Emergency and Radiation Medicine EMERCOM of Russia
Russian Federation
Davydova Natalya Ivanovna - PhD (Medicine), Head, Laboratory of Immunology.
St. Petersburg
Competing Interests: not
A. O. Avetisyan
Saint-Petersburg State Research Institute of Phthisiopulmonology of the Ministry of Healthcare of the Russian Federation
Russian Federation
Avetisyan Armen O nikovich - PhD, (Medicine), Head, Thoracic Surgical Department for Tuberculosis Patients
Competing Interests: not
P. K. Yablonskii
St. Petersburg State Research Institute of Phthisiopulmonology ; St. Petersburg State University
Russian Federation
Yablonsky Peter Kazimirovich - PhD, MD (Medicine), Professor, Director, SPS RI P; Dean, Medical Faculty, SPSU
Competing Interests: not
References
1. Yesimova I.Ye., Urazova O.I., Novitsky V.V., Khasanova R.R., Koshkina A.A., Churina Ye.G. The causes of dysregulation of immune response in pulmonary tuberculosis: the impact of M. tuberculosis on the course of immune response. Byulleten sibirskoy meditsiny = Bulletin of Siberian Medicine, 2012, no. 3, pp. 79-86. (In Russ.)
2. Kitaev M.I., Dudenko E.V., Sydykova S., Toktogonova A.A., Chonorova O.A. Cytokine balance in the process of chemotherapy of pulmonary tuberculosis with drug-resistant mycobacteria. Vestnik Kirgizsko-Rossiyskogo Slavyanskogo universiteta = Bulletin of theKyrgyz-Russian Slavic University (Kyrgyzstan), 2014, no. 4, pp. 101-103. (In Russ.)
3. Knoring B.E., Davydova N.I., Basek T.F., Nitsa N.A., Elkin A.V. Indicators of immunity in patients with progressive fibro-cavernous tuberculosis, depending on the severity of destructive changes in the lungs. Meditsinskaya immunologiya = Medical Immunology (Russia), 2012, Vol. 14, no. 4-5, pp. 329-336. (In Russ.) doi: 10.15789/1563-0625-2012-4-5-329-336.
4. Menyaylo M.E., Malashchenko V.V., Shmarov V.A., Gazatova N.D., Melashchenko O.B., Goncharov A.G., Seledtsova G.V., Seledtsov VI. The role of interleukin-8 in the direct regulation of the functional activity of T-lymphocytes. Meditsinskaya immunologiya = Medical Immunology (Russia), 2017, Vol. 19, no. 5, pp. 529-536. (In Russ.) doi: 10.15789/1563-0625-2017-5-529-536.
5. Pichugin A.V., Apt A.S. Apoptosis of the cells of the immune system during tuberculosis infection. Problemy tuberkuleza i bolezney legkikh = Problems of Tuberculosis and Lung Diseases, 2005, no. 12, pp. 3-7. (In Russ.)
6. Potapnev M.P. Apoptosis of the cells of the immune system and its regulation by cytokines. Immunologiya = Immunology, 2002, no. 4, pp. 237-243. (In Russ.)
7. Potapnev M.P. Autophagy, apoptosis, cell necrosis and immune recognition of one’s own and someone else’s. Immunologiya = Immunology, 2014, no. 2, pp. 95-102. (In Russ.)
8. Ryazantseva N.V., Novitsky V.V., Zhukova O.B., Sazonova E.V., Chechina O.E., Biktasova A.K., Baikov A.N. Molecular mechanisms of the effect of interleukin-2 on apoptosis of blood lymphocytes. Kletochnye tekhnologii v biologii i meditsine = Cell Technologies in Biology and Medicine, 2010, no. 2, pp. 116-120. (In Russ.)
9. Salina T.Yu., Morozova T.I. Klinicheskaya laboratornaya diagnostika = Russian Clinical Laboratory Diagnostics, 2013, no. 3, pp. 18-20. (In Russ.)
10. Salina T.Yu., Morozova T.I. FAS (CD95) antigen and the production of tumor necrosis facto in the peripheral blood of patients with different clinical manifestations of tuberculosis. Pulmonologiya = Russian Pulmonology, 2015, Vol. 15, no. 4, pp. 456-460. (In Russ.)
11. Sakhno L.V, Tikhonova M.A., Kurganova E.V., Shevela E.Ya., Nikonov S.D., Zhdanov O.A., Mostovaya G.V, Ostanin A.A., Chernykh E.R. T-cell anergy in the pathogenesis of immune insufficiency in pulmonary tuberculosis. Problemy tuberkuleza i bolezney legkikh = Problems of Tuberculosis and Lung Diseases, 2004, no. 11, pp. 23-28. (In Russ.)
12. Sakhno L.V., Tikhonov M.A., Nikonov S.D., Zhdanov O.A., Osta A.A., Chernykh E.R. Dysfunctions of macrophages generated from monocytes in the blood of patients with pulmonary tuberculosis. Byulleten Sibirskogo otdeleniya Rossiyskoy akademii meditsinskikh nauk = Bulletin of Siberian Branch of Russian Academy of Medical Sciences, 2010, Vol. 30, no. 2, pp. 101-108. (In Russ.)
13. Simbirtsev A.S. Cytokines in the pathogenesis and treatment of human diseases]. St. Petersburg: Foliant, 2018. 512 p.
14. Somova L.M., Besednova N.N., Plekhova N.G. Apoptosis and infectious disease. Infektsiya i immunitet = Russian Journal of Infection and Immunity, 2014, Vol. 4, no. 4, pp. 303-318. (In Russ.) doi: 10.15789/2220-7619-2014-4-303-318.
15. Filinyuk O.V., Yanova G.V., Strelis A.K., Urazova O.I., Zemlyanaya N.A., Buynova L.N. Multiple drug-resistant pulmonary tuberculosis: medico-social features and effectiveness of the inpatient treatment phase. Problemy tuberkuleza i boleznej legkih = Problems of Tuberculosis and Lung Diseases, 2008, no. 8, pp. 23-28. (In Russ.)
16. Khonina N.A., Sakhno L.V, Norkin M.N., Norkina O.V., Mostovaya G.V, Nikonov S.D., Ogirenko A.P., Ostanin A.A., Chernykh E.R. Lymphocyte apoptosis as a possible mechanism of violation of the antigen-specific response in pulmonary tuberculosis. Meditsinskaya immunologiya = Medical Immunology (Russia), 2001, Vol. 3, no. 1, pp. 51-59. (In Russ.)
17. Chasovskikh N.Yu., Ryazantseva N.V., Novitsky V.V., Filipenko M.L., Boyarskikh U.A., Starikova E.G., Kaygorodova E.V, Starikov Yu.V., Sokolovich E.G.. BCL-2 proteins are involved in the redox-dependent deregulation of apoptosis of mononuclear blood leukocytes during inflammation. Immunologiya = Immunology, 2009, no. 2, pp. 98-101. (In Russ.)
18. Chechina O.Ye., Biktasova A.K., Sazonova Ye.V, Zhukova O.B., Prokhorenko T.S., Krat I.V, Chasovskikh N.Yu., Novitsky V.V., Ryazantseva N.V. The role of cytokines in redox-dependent regulation of apoptosis. Byulleten sibirskoy meditsiny = Bulletin of Siberian Medicine, 2009, no. 2, pp. 67-72. (In Russ.)
19. Chechina O.Ye., Ryazantseva N.V., Novitsky V.V., Sazonova E.V., Biktasova A.K., Zhukova O.B., Maroshkina A.N., Belkina M.V, Kaigorodova E.V., Prokhorenko T.S. Proteins of the BCL-2 family - molecular targets for the pro-apoptotic action of IL-2 and IL-4. Immunologiya = Immunology, 2011, no. 3, pp. 127-130. (In Russ.)
20. Churina E.G., Novitsky V.V., Urazova O.I., Filinyuk O.V, Teplova N.V, Esimova I.E. Indicators of apoptosis and proliferative activity of lymphocytes in patients with tuberculosis of the lung with multidrug resistance to M. tuberculosis. Meditsinskaya immunologiya = Medical Immunology (Russia), 2012, Vol. 14, no. 1-2, pp. 119-126. (In Russ.) doi: 10.15789/1563-0625-2012-1-2-119-126.
21. Churina E.G., Urazova O.I., Novitskiy V.V., Esimova I.E., Kononova T.E., Filinyuk O.V., Kolobovnikova Yu.V., Dmitrieva A.I. Factors of dysregulation of the immune response (at various stages of its implementation) in pulmonary tuberculosis. Byulleten sibirskoy meditsiny = Bulletin of Siberian Medicine, 2016, Vol. 15, no. 5, pp. 166-177. (In Russ.)
22. Yurova K.A., Khaziakhmatova O.G., Todosenko N.M., Litvinova L.S. Assessment of the effect of yC-cytokines (IL-2, IL-7 and IL-15) on the expression of late activation molecules and apoptosis (CD95 And HLA-DR) CD4+ CD8+ T-lymphocytes in the population of CD45RA T cells in vitro. Immunologiya = Immunology, 2018, Vol. 39, no. 1, pp. 20-25. (In Russ.)
23. Yarilin A.A., Nikonova M.F., Yarilina A.A., Varfolomeeva M.I., Grigorieva T.Yu. Apoptosis, the role in pathology and the significance of its assessment in the clinical and immunological examination of patients. Meditsinskaya immunologiya = Medical Immunology (Russia), 2000, Vol. 2, no. 1, pp. 7-16. (In Russ.)
24. Boussiotis V., Tsai E.Y., Yunis E.J., Thim S., Delgado J.C., Dascher C.C., Berezovskaya A., Rousset D., Reynes J.-M., Goldfeld A.E. IL-10-producing T cells suppress immune responses in anergic tuberculosis patients. J. Clin. Invest., 2000, Vol. 105, no. 9, pp. 1317-1325.
25. Briken V, Miller J.L. Living on the edge: inhibition of host cell apoptosis by Mycobacterium tuberculosis. Future Microbiol., 2008, Vol. 3, no. 4, pp. 415-422.
26. Choi S.H., Park J.Y., Kang W, Kim S.U., Kim D.Y., Ahn S.H., Ro S.W., Han K.H. Knockdown of HIF-1a and IL-8 induced apoptosis of hepatocellular carcinoma triggers apoptosis of vascular endothelial cells. Apoptosis, 2016, Vol. 21, no. 1, pp. 85-95.
27. Devireddy L.R., Green M.R. Transcriptional program of apoptosis induction following interleukin 2 deprivation: identification of RC3, a calcium/calmodulin binding protein, as a novel proapoptotic factor. Mol. Cell. Biol., 2003, Vol. 23, no. 13, pp. 4532-4541.
28. Douglas I.S., Diaz del Valle F., Winn R.A., Voelkel N.F. Beta-catenin in the fibroproliferative response to acute lung injury. Am. J. Respir. Cell Mol. Biol., 2006, Vol. 34, no. 3, pp. 274-285.
29. Eum S.Y., Jeon B.Y., Min J.H., Kim S.C., Cho S., Park S.K., Cho S. Tumor necrosis factor-alpha and interleukin-10 in whole blood is associated with disease progression in pulmonary multidrug-resistant tuberculosis patients. Respiration, 2008, Vol. 76, no. 3, pp. 331-337.
30. Hildeman D.A., Zhu Y., Mitchell T.C., Kappler J., Marrack P. Molecular mechanisms of activated T cell death in vivo. Curr. Opin. Immunol., 2002, Vol. 14, no. 3, pp. 354-359.
31. Hirsch C.S., Johnson J.L., Okwera A., Kanost R.A., Wu M., Peters P., Muhumuza M., Mayanja-Kizza H., Mugerwa R.D., Mugyenyi P., Ellner J.J., Toossi Z. Mechanisms of apoptosis of T-cells in human tuberculosis. J. Clin. Immunol., 2005, Vol. 25, pp. 353-364.
32. Hirsch C.S., Toossi Z., Vanham G., Johnson J.L., Peters P., Okwera A., Mugerwa R., Mugyenyi P., Ellner J.J. Apoptosis and T cell hyporesponsiveness in pulmonary tuberculosis. Infect. Dis., 1999, Vol. 179, no. 4, pp. 945-953.
33. Kleinnijenhuis J., Oosting M., Plantinga T., van der Meer J.W., Joosten L.A., Crevel R.V., Netea M.G. Autophagy modulates the Mycobacterium tuberculosis-induced cytokine response. Immunology, 2011, Vol. 134, pp. 341-348.
34. Knoring B.E., Davydova N.I., Shulgina M.V., Kravtsov V.Y., Zilber E.K., Yablonskii P.K. Features of cytokine profile in patients with progressive TB-induced pulmonary fibrosis characterized by various intensities of pulmonary destructive changes. Prensa. Med. Argen., 2016, Vol. 102, no. 2, pp. 2-9.
35. Lee J.S., Song C.H., Lim J.H., Kim H.J., Park J.K., Paik T.H. Kim C.H., Kong S.J., Shon M.H., Jung S.S., Jo E.K. The production of tumour necrosis factor-alpha is decreased in peripheral blood. Clin. Exp. Immunol., 2003, Vol. 132, no. 3, pp. 443-449.
36. Moore K.W., de Waal Malefyt R., Coffman R.L., О’Garra A. Interleukin-10 and the interleukin-10 receptor. Annu. Rev. Immunol., 1993, Vol. 11, pp. 165-190.
37. Moraco A.H., Kornfeld H. Cell death and autophagy in tuberculosis. Semin. Immunol., 2014, Vol. 26, no. 6, pp. 497-511.
38. Morrison J., Pai M., Hopewell P.C. Tuberculosis and latent tuberculosis infection in close contacts of people with pulmonary tuberculosis in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Infect. Dis., 2008, Vol. 8, pp. 359-368.
39. Orme I.M. A new unifying theory of the pathogenesis of tuberculosis. Tuberculosis, 2014, Vol. 94, no. 1, pp. 8-14.
40. Pang X., Li K., Wei L., Huang Y., Su M., Wang L., Cao H., Chen T. IL-8 inhibits the apoptosis of MCF-7 human breast cancer cells by up-regulating Bcl-2 and down-regulating caspase-3. Xi Bao Yu Fen Zi Mian Yi Xue Za Zhi, 2015, Vol. 31, no. 3, pp. 307-311.
41. Parandhaman D.K., Narayanan S. Cell death paradigms in the pathogenesis of Mycobacterium tuberculosis infection. Front. Cell Infect. Microbiol., 2014, no. 4, p. 31.
42. Pericl F., Liu J.H., Diaz J.I., Blanchard D.K., Wei S., Forni G., Djeu J.Y. Interleukin-2 prevention of apoptosis in human neutrophils. Eur. J. Immunol., 1994, Vol. 24, no. 2, pp. 440-444.
43. Quesniaux V.F., Jacobs M., Allie N., Grivennikov S., Nedospasov S.A., Garcia I, Olleros M.L., Shebzukho Y., Kupras D., Vasseur V., Rose S., Court N., Vache R., Ryffel B. TNF in host resistance to tuberculosis infection. Curr. Dir. Autoimmun., 2010, Vol. 11, pp. 157-179.
44. Raeber M.E., Zurbuchen Y., Impellizzieri D., Boyman O. The role of cytokines in T-cell memory in health and disease. Immunol. Rev., 2018, Vol. 283, no. 1, pp. 176-193.
45. Rakotosamima N., Doherty T.M., Andriamihantasoa L.H., Richard V., Gicquel B., Soares J.L., Zumla A., Razanamparany V.R. Expression of TNF-alpha-dependent apoptosis-related genes in the peripheral blood of Malagasy subjects with tuberculosis. PLoS oNe, 2013, Vol. 8, no. 4, e61154. doi: 10.1371/journal.pone.0061154.
46. Refaeli Y., van Parijs L., London C.A., Tschopp J., Abbas A.K. Biochemical mechanisms of IL-2-regulated Fas-mediated T cell apoptosis. Immunity, 1998, Vol. 8, no. 5, pp. 615-623.
47. Saini N.K., Sinha R., Singh P., Sharma M., Pathak R., Rathor N., Varma-Basil M., Bose M. Mce4A protein of Mycobacterium tuberculosis induces pro inflammatory cytokine response leading to macrophage apoptosis in a TNF-a dependent manner. Microb. Pathog., 2016, Vol. 100, pp. 43-50.
48. Shi J., Sun B.H., Zhou L.R., Wang X.S. Role of IL-10 and TNF-a during Mycobacterium tuberculosis infection in murine alveolar macrophage. Genet. Mol. Res., 2016, Vol. 15, no. 3. doi: 10.4238/gmr.15037819.
49. Simmons J.D., Catherine M. Stein C.M., Seshadri C., Campo M., Alter G., Fortun S., Schurr E., Wallis R.S., Churchyard G., Mayanja-Kizza H., Boom WH. , Hawn T.R. Immunological mechanisms of human resistance to persistent Mycobacterium tuberculosis infection. Nat. Rev. Immunol., 2018, Vol. 18, pp. 575-589.
50. Tan Q., Xie W.P., Min R., Dai G.Q., Xu C.C., Pan H.Q., Miao C.D., Yang Z., Xu W.G., Wang H. Characterization of Th1- and Th2-type immune response in human multidrug-resistant tuberculosis. Eur. J. Clin. Microbiol. Infect. Dis., 2012, Vol. 31, no. 6, pp. 1233-1242.
51. Vanham G., Toossi Z., Hirsch C.S., Wallis R.S., Schwander S.K., Rich E.A., Ellner J.J. Examining a paradox in the pathogenesis of human pulmonary tuberculosis: immune activation and suppression/anergy. Tuber. Lung Dis., 1997, Vol. 78, no. 3-4, pp. 145-158.
52. Vignali DA., Collison L.W, Workman C.J. How regulatory T cells work. Nat. Rev. Immunol., 2008, Vol. 8, no. 7, p. 523.
53. Wang G., Lin A., Han Q., Zhao H., Tian Z., Zhang J. IFN-y protects from apoptotic neutrophil-mediated tissue injury during acute Listeria monocytogenes infection. Eur. J. Immunol., 2018, Vol. 48, no. 9, pp. 1470-1480.
54. Yan L., Cui H., Xiao H., Zhang Q. Anergic pulmonary tuberculosis is associated with contraction of the Vd2+T cell population, apoptosis and enhanced inhibitory cytokine production. PLoS ONE, 2013, Vol. 8, no. 8, e71245. doi: 10.1371/journal.pone.0071245.
55. Zhai W, Wu F., Zhang Y., Fu Y., Liu Z. The immune escape mechanisms of Mycobacterium tuberculosis. Int. J. Mol. Sci., 2019, Vol. 20, no. 2, p. 340.
Supplementary files
![]() |
1. Metadata | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Анализ данных | |
Download
(16KB)
|
Indexing metadata ▾ |
![]() |
2. title page | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(19KB)
|
Indexing metadata ▾ |
![]() |
3. abstract | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(17KB)
|
Indexing metadata ▾ |
![]() |
4. Table 1 | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(18KB)
|
Indexing metadata ▾ |
![]() |
5. Table 2 | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(15KB)
|
Indexing metadata ▾ |
![]() |
6. Table 3 | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(20KB)
|
Indexing metadata ▾ |
![]() |
7. Table 4 | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(21KB)
|
Indexing metadata ▾ |
![]() |
8. Table 5 | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(20KB)
|
Indexing metadata ▾ |
![]() |
9. literature | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
Download
(65KB)
|
Indexing metadata ▾ |
|
10. author's signatures | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Исследовательские инструменты | |
View
(1MB)
|
Indexing metadata ▾ |
![]() |
11. Метаданные | |
Subject | туберкулез легких; апоптоз лимфоцитов; иммунный ответ | |
Type | Анализ данных | |
Download
(B)
|
Indexing metadata ▾ |
![]() |
12. Metadata | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Анализ данных | |
Download
(B)
|
Indexing metadata ▾ |
![]() |
13. metadata additional file | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Анализ данных | |
Download
(B)
|
Indexing metadata ▾ |
![]() |
14. Lymphocyte apoptosis and immune response in patients with drug-resistant fibro-cavernous tuberculosis with different prevalence of destructive changes in the lungs. | |
Subject | pulmonary tuberculosis; lymphocyte apoptosis; immune response | |
Type | Анализ данных | |
Download
(B)
|
Indexing metadata ▾ |
Review
For citations:
Knoring B.E., Davydova N.I., Avetisyan A.O., Yablonskii P.K. Lymphocyte apoptosis and immune response in patients with drug-resistant fibro-cavernous tuberculosis with different prevalence of destructive changes in the lungs. Medical Immunology (Russia). 2019;21(6):1099-1114. (In Russ.) https://doi.org/10.15789/1563-0625-2019-6-1099-1114