Audit Assessment of the Effectiveness of Public Procurement Procedures

Main Article Content

Iryna Drozd
Mariia Pysmenna
Nataliia Pohribna
Nataliya Zdyrko
Anna Kulish

Abstract

The article seeks describing the benefits and challenges faced by auditors in assessing the effectiveness of public procurement procedures in terms of applying the methodology for calculating efficiency, economy and effectiveness, taking into account the risks of procurement in e-auctions. Quantitative risk parameters are calculated using data of probabilistic indicators of procurement risk assessment according to the ratio of the number of relevant procedures (sub-threshold and above-threshold) to the total number of procurement procedures. Statistical valuation methods are used for the cost risk assessments and calculation of the aggregate risk indicator of public procurement. The calculations are performed using the data of the open e-procurement system ProZorro for all announced procurements in 2018-2019. We analyzed the methods, indicators and the extent to which the study of the public procurement effectiveness via bibliographic and case studies is performed. As a result, the majority of methods cover four components of assessing the public procurement efficiency - targeted efficiency, cost-effectiveness, organizational efficiency, efficiency of budget expenditures for public procurement. This does not provide an assessment of the automated systems’ impact on the procurement procedures results and on possible savings due to the use of certain procurement procedures. To comprehensively assess the procurement efficiency in e-bidding, the authors propose considering four key risks: the risk of cancellation of the procurement procedure, the risk that the procurement procedure will not take place, the risk of appealing the procurement, the risk of disqualification. As a result of risks calculations under the sub-threshold and above-threshold procurement, individual values of risks and their aggregate indicator are determined. This will adjust the scope of audit procedures to verify individual procurements and identify weaknesses in the procurement management system. We believe that the methodology of auditing the procurement effectiveness, taking into account the quantitative and qualitative parameters of procurement risks, will be a useful audit tool to determine the effectiveness of the use of public funds under individual procurements and identify areas of cost-effectiveness for the state budget funds.

Downloads

Download data is not yet available.

Article Details

Section
Integration System of Education, Science and Production
Author Biographies

Iryna Drozd, Taras Shevchenko National University of Kyiv

Doctor of Economics, Professor, Center of advanced training, Institute of postgraduate education, Taras Shevchenko National University of Kyiv (Ukraine). She is the Chairman of the Scientific and Expert Council at the State Treasury Service of Ukraine, a member of the Methodological Council on Accounting under the Ministry of Finance of Ukraine, the author of more than 110 scientific works. She has an experience in external and internal audit, accounting in the public sector of the economy. Scientific interests: external and internal audit, public procurement, government accounting and financial reporting.

Mariia Pysmenna, Flying Academy of National Aviation University

Doctor of Economics, Department of Management, Faculty of Management, Flying Academy of National Aviation University, (Ukraine). She is the Editor-in-Chief of the collection "Scientific Bulletin of the Flight Academy. Economics, Management and Law Series" from 2019, the author of more than 75 scientific works. She has an experience in the field of internal audit of the bank, management of corporate finance, public procurement. Scientific interests: public finance, control and analysis of the public procurement system, internal audit of banks, accounting and financial reporting.

Nataliia Pohribna, Taras Shevchenko National University of Kyiv

Ph.D. in Economics, Department of Finance, Faculty of Economics, Taras Shevchenko National University of Kyiv (Ukraine). She is the author of 65 scientific and educational works. She has experience in the field of financial management and financial analysis. 

Scientific interests: professional ethics and standards of practice in finance, leadership and ethics in public sector, financial globalization, capital markets, financial stabilization of universities.

Nataliya Zdyrko, Vinnytsia National Agrarian University

Doctor of Science (Economics), Associate Professor,  Dean of the Faculty of Accounting and Audit. She teaches disciplines taught:  audit, public procurement control, computer audit, public financial control, control and audit. Scientific interests: public financial control, public audit, analysis and control of public procurement, international auditing standards. Author of more than 110 scientific works. ScopusID 57192835222 

Anna Kulish , Kyiv National Economic University named after Vadim Hetman

Ph. D. in Economics, Professor of Accounting, Department of Corporate Finance and Controlling. She teaches disciplines: Corporate Finance, Financial management, Financial Analysis. Scientific interests: The Financial Analysis in the management of the enterprise,  Strategic management, Financial management, Financial Controlling. Author of more than 99 scientific works. 

References

Accounting Chamber (2019). Report on the analysis of the functioning of the public procurement system. Available: https://rp.gov.ua/upload-files/Activity/Collegium/2019/12-2_2019/Zvit_12-2_2019.pdf. Access: 1th April, 2020.

Accounting Chamber (2020). Information on «Savings» of UAH 28.2 billion in public procurement in 2019 is contradictory. Available: https://rp.gov.ua/PressCenter/News/?id=908. Access: 6th April, 2020.

Adi, S., & Dutil, P. (2018). Searching for strategy: Value for Money (VFM) audit choice in the new public management era. Canadian Public Administration, 10.1111/capa.12254, 61(1), (91-108). DOI: https://doi.org/10.1111/capa.12254.

Antoniuk, O., Chyzhevska, L., & Semenyshena, N. (2019). Legal regulation and trends of audit services: what are the differences (evidence of Ukraine). Independent Journal of Management & Production, 10(7), 673-686. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.903

Antoniuk, O., Kuzyk, N., Zhurakovska, I., Sydorenko, R., & Sakhno, L. (2020). The Role of «Big Four» Auditing Firms in the Public Procurement Market in Ukraine. Independent Journal of Management & Production, 11(9), 2483-2495. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1432.

Arrowsmith, S., Linarelli, J., & Don Wallace, JR. (2000). Regulating Public Procurement. National and International Perspectives. Kluwer Law International.

Beuve, J., Moszoro, M. W., & Saussier, S. (2018). Political contestability and public contract rigidity: An analysis of procurement contracts. Journal of Economics & Management Strategy. doi:10.1111/jems.12268.

Bowerman, M., Raby, H., & Humphrey, C. (2000). In Search of the Audit Society: Some Evidence from Health Care, Police and Schools. International Journal of Auditing, 4(1), 71–100. DOI:10.1111/1099-1123.00304.

Duncombe, W., & Searcy, C. (2007). Can the Use of Recommended Procurement Practices Save Money? Public Budgeting & Finance, 27(2), 68–87. DOI:10.1111/j.1540-5850.2007.00875.x.

Fesenko, V., Vakulchyk, O., Guba, O., Ostapchuk, S., & Babich, I. (2020). The Results of Implementation of European Requirements in Management of Transfer Pricing Audit (Experience of Ukraine). Independent Journal of Management & Production, 11(9), 2417-2434. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1412.

Goncharenko, L. P., & Filin, S. A. (2016). Risk management. Moscow: KNORUS.

Ivanova, O. V. (2010). Methodology for a comprehensive assessment of the effectiveness of public procurement of the Oryol region. Bulletin of TulSU. Economic and legal sciences, 2, 183-192.

Karlöf, B. (1996). New age efficiency and demands on organizations. Strategic Change, 5(1), 43–48. DOI:10.1002/(sici)1099-1697(199601)5:1<43::aid-jsc211>3.0.co;2-a.

Khorunzhak, N., Belova, I., Zavytii, O., Tomchuk, V., & Fabiianska, V. (2020). Quality Control of Auditing: Ukrainian Prospects. Independent Journal of Management & Production, 11(8), 712-726. DOI: dx.doi.org/10.14807/ijmp.v11i8.1229.

Khorunzhak, N., Brukhanskyi, R., & Ivanyshyn, V. (2019). Logic-statistical information models in control function of accounting. Independent Journal of Management & Production, 10(7), 846-871. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.906.

Kroll, Y., & Levy, H. (1980). Sampling Errors and Portfolio Efficient Analysis. Journal of Financial and Quantitative Analysis, 15(3), 655-688. DOI:10.2307/2330403.

Lambert-Mogiliansky, A., & Sonin, K. (2006). Collusive Market Sharing and Corruption in Procurement. Journal of Economics Management Strategy, 15(4), 883–908. doi:10.1111/j.1530-9134.2006.00121.x.

Lapin, A. E., Kiseleva, O.V., & Kumundzhieva, E. L. (2016). Approaches to assessing the effectiveness of the contract system in the field of state and municipal procurement. Business. Education. Right. Bulletin of the Volgograd Institute of Business, 11(34), 30-35.

MAPS (2018). Methodology for Assessing Procurement Systems. Available: http://www.mapsinitiative.org/methodology/MAPS-methodology-for-assessing-procurement-systems.pdf. Access: 18th June, 2020.

Mayne, J., & Ontario, O. (2006). Audit and evaluation in public management: challenges, reforms, and different roles. The Canadian Journal of Program Evaluation, 21(1), 11–45.

McCrae, M., & Vada, H. (1997). Performance Audit Scope and the Independence of the Australian Commonwealth Auditor‐General. Financial Accountability & Management, 13(3). DOI: https://doi.org/10.1111/1468-0408.00034.

Melnyk, N., Trachova, D., Kolesnikova, O., Demchuk, O., & Golub, N. (2020). Accounting Trends in the Modern World. Independent Journal of Management & Production, 11(9), 2403-2416. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1430.

Methodological (2008). Methodological recommendations for assessing the effectiveness and transparency of placing state and municipal orders. Moscow: Delovoy dvor.

Moncrieffe, J., & Luttrell, C. (2005). Аn analytical framework for understanding the political economy of sectors and policy arenas. Overseas Development Institute. Availiable: http://www.odi.org/sites/odi.org.uk/files/ odi-assets/publications-opinion-files/3898.pdf. Access: 1th MarchMay, 2020.

Nesterovich, N. V. (2008). N. 94-FZ: how to find savings. State order: Management, Placement, Provision. 12 (April, June), 32–35.

Pasko, O., Melnychuk, O., & Bilyk T. (2019). Ownership concentration, investor protection and economic performance in public agroindustrial companies with the listing on Warsaw stock exchange. Independent Journal of Management & Production, 10(7), 817-845. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.914.

Perov, K. A., Dashkov, S. B., & Abdrakhimov, D. A. (2006). Development of a methodology for calculating the economic efficiency of placing orders for the supply of goods, performance of work, provision of services for state and municipal needs: research report. Moskow: LTD Institute of Competitive Technologies.

Pollitt, C. (2013). The logics of performance management. Evaluation, 19(4), 346–363. DOI: https://doi.org/10.1177/1356389013505040.

Pollitt, C., Girre, X., Lonsdale, J., Mul, R., Summa, H., & Waerness, M. (1999). Performance or Compliance? Performance Audit and Public Management in Five Countries. Oxford: Oxford University Press.

Prozorro (2020). ProZorro is a hybrid electronic open source government e-procurement system. Available: https://prozorro.gov.ua/ Access: 5th June, 2020.

PUBLIC PROCUREMENT IN THE EU (2016). Public Procurement in the EU: Legislative Framework, Basic Principles and Institutions. Available: http://www.sigmaweb.org/publications/Public-Procurement-Policy-Brief-1-200117.pdf . Access: 1th November, 2018.

Pyismenna, M. (2017). Written by MS State audit and analysis of public procurement: theory, methodology and practice. Kyiv: Center for Educational Literature.

Rodrigues, P. C. C., & Semenyshena, N. (2019). Editorial Introduction. Independent Journal of Management & Production, 10(7), 911-914. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.775.

Rodrigues, P. C. C., & Semenyshena, N. (2020). Special Edition (Integration System of Education, Science and Production) Introduction. Independent Journal of Management & Production, 11(8), 801-806. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.775

Rodrigues, P. C. C., Simanaviciene, Z., & Semenyshena, N. (2020). Editorial Volume 11, Issue 9. Independent Journal of Management & Production, 11(9), 2542-2547. DOI: http://dx.doi.org/10.14807/ ijmp.v11i9.1424

RPP (2015). Recommendation on Public Procurement: Public Procurement is the cornerstone of strategic governance. Available: http://www.oecd.org/gov/public-procurement/recommendation/OECD-Recommendation-on-Public-Procurement.pdf. Access: 24th April, 2020.

Semenyshena, N., Khorunzhak, N., & Zadorozhnyi, Z.-M. (2020). The Institutionalization of accounting: the impact of national standards on the development of economies. Independent Journal of Management & Production, 11(8), 695-711. DOI: https://doi.org/10.14807/ijmp.v11i8.1228.

Semenyshena, N., Sysiuk, S., Shevchuk, K., Petruk, I., & Benko, I. (2020). Institutionalism in Accounting: a Requirement of the Times or a Mechanism of Social Pressure? Independent Journal of Management & Production, 11(9), 2516-2541. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1440.

Shevchuk, V. O. (1998). Control of economic systems in a society in transition (problems of theory, organization, methodology). Kyiv: Kyiv State University of Trade and Economics.

Slobodyanik, Y., Kondriuk, L., & Haibura, Y. (2019). The Strategy of Institutional Reform of the Supreme Audit Institution: the Case of Ukraine. Independent Journal of Management & Production, 10(7). DOI: http://dx.doi.org/10.14807/ijmp.v10i7.916.

Sollish, F., & Semanik, J. (2012). The Procurement and Supply Manager's Desk Reference. Chapter 4 Supplier Selection Criteria Book Editor(s): Wiley. DOI: https://doi.org/10.1002/9781119205098.ch4.

Spiller, P., Reinecke, N., Ungerman, D., & Teixeira, H. (2013). Procurement 20/20: Supply Entrepreneurship in a Changing World. In: Chapter 7 The New Economic Drivers: Capturing the Total Impact of Environmental, Social, and Regulatory Factors, ch. 7. DOI: https://doi.org/10.1002/9781119204985.ch7.

Stupakov, V. S., & Tokarenko, G.S. (2005). Risk management. Moscow: Finance and Statistics.

Uncitral (2011). Model Law on Public Procurement. Available: https://uncitral.un.org/en/texts/procurement/modellaw/public_procurement. Access: 7th June, 2020.

Vdovenko, N., Piven, A., Radchenko, O., Sinenok, I., & Voskobiinyk, S. (2020). Institutional Environment for Financial Provision of Small Agricultural Business Entities of Ukraine. Independent Journal of Management & Production, 11(9), 2379-2402. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1419.

Waters, D. (2015). Logistics. Supply chain management. Logistics. An Introduction to Supply Chain Management. Moscow: UNITY-DANA.

White, G. R. T., Parfitt, S., Lee, C., & Mason-Jones, R. (2016). Challenges to the Development of Strategic Procurement: A Meta-Analysis of Organizations in the Public and Private Sectors. Strategic Change, 25(3), 285–298. DOI:10.1002/jsc.2061.

Zaiets, N. M. (2017). A pilot analysis of the procurement procedures. Bulletin of ZhDTU. Series: Economics of Science, 1(179), 72-80.