Audit Assessment of the Effectiveness of Public Procurement Procedures

Iryna Drozd; Mariia  Pysmenna; Nataliia  Pohribna; Nataliya  Zdyrko; Anna  Kulish

doi:10.14807/ijmp.v12i3.1522

PDF HTML

Published: May 1, 2021

DOI: https://doi.org/10.14807/ijmp.v12i3.1522

Keywords:

Public Procurement Risks Audit Audit Assessment Efficiency Finance Enterprises

Iryna Drozd

Taras Shevchenko National University of Kyiv

https://orcid.org/0000-0002-1930-2522

Mariia Pysmenna

Flying Academy of National Aviation University

https://orcid.org/0000-0003-4509-8147

Nataliia Pohribna

Taras Shevchenko National University of Kyiv

https://orcid.org/0000-0003-3867-9701

Nataliya Zdyrko

Vinnytsia National Agrarian University

https://orcid.org/0000-0001-5968-3502

Anna Kulish

Kyiv National Economic University named after Vadim Hetman

https://orcid.org/0000-0001-5439-121X

Abstract

The article seeks describing the benefits and challenges faced by auditors in assessing the effectiveness of public procurement procedures in terms of applying the methodology for calculating efficiency, economy and effectiveness, taking into account the risks of procurement in e-auctions. Quantitative risk parameters are calculated using data of probabilistic indicators of procurement risk assessment according to the ratio of the number of relevant procedures (sub-threshold and above-threshold) to the total number of procurement procedures. Statistical valuation methods are used for the cost risk assessments and calculation of the aggregate risk indicator of public procurement. The calculations are performed using the data of the open e-procurement system ProZorro for all announced procurements in 2018-2019. We analyzed the methods, indicators and the extent to which the study of the public procurement effectiveness via bibliographic and case studies is performed. As a result, the majority of methods cover four components of assessing the public procurement efficiency - targeted efficiency, cost-effectiveness, organizational efficiency, efficiency of budget expenditures for public procurement. This does not provide an assessment of the automated systems’ impact on the procurement procedures results and on possible savings due to the use of certain procurement procedures. To comprehensively assess the procurement efficiency in e-bidding, the authors propose considering four key risks: the risk of cancellation of the procurement procedure, the risk that the procurement procedure will not take place, the risk of appealing the procurement, the risk of disqualification. As a result of risks calculations under the sub-threshold and above-threshold procurement, individual values of risks and their aggregate indicator are determined. This will adjust the scope of audit procedures to verify individual procurements and identify weaknesses in the procurement management system. We believe that the methodology of auditing the procurement effectiveness, taking into account the quantitative and qualitative parameters of procurement risks, will be a useful audit tool to determine the effectiveness of the use of public funds under individual procurements and identify areas of cost-effectiveness for the state budget funds.

Downloads

Download data is not yet available.

Issue

Vol. 12 No. 3 (2021): Independent Journal of Management & Production (Special Edition ISE, S&P)

Section

Integration System of Education, Science and Production

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

1. Proposal of Policy for Free Access Periodics

Authors whom publish in this magazine should agree to the following terms:

a. Authors should keep the copyrights and grant to the magazine the right of the first publication, with the work simultaneously permitted under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 that allows the sharing of the work with recognition of the authorship of the work and initial publication in this magazine.

b. Authors should have authorization for assuming additional contracts separately, for non-exclusive distribution of the version of the work published in this magazine (e.g.: to publish in an institutional repository or as book chapter), with recognition of authorship and initial publication in this magazine.

c. Authors should have permission and should be stimulated to publish and to distribute its work online (e.g.: in institutional repositories or its personal page) to any point before or during the publishing process, since this can generate productive alterations, as well as increasing the impact and the citation of the published work (See The Effect of Free Access).

Proposal of Policy for Periodic that offer Postponed Free Access

Authors whom publish in this magazine should agree to the following terms:

a. Authors should keep the copyrights and grant to the magazine the right of the first publication, with the work simultaneously permitted under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 [SPECIFY TIME HERE] after the publication, allowing the sharing of the work with recognition of the authorship of the work and initial publication in this magazine.

b. Authors should have authorization for assuming additional contracts separately, for non-exclusive distribution of the version of the work published in this magazine (e.g.: to publish in institutional repository or as book chapter), with recognition of authorship and initial publication in this magazine.

c. Authors should have permission and should be stimulated to publish and to distribute its work online (e.g.: in institutional repositories or its personal page) to any point before or during the publishing process, since this can generate productive alterations, as well as increasing the impact and the citation of the published work (See The Effect of Free Access).

d. They allow some kind of open dissemination. Authors can disseminate their articles in open access, but with specific conditions imposed by the editor that are related to:
   Version of the article that can be deposited in the repository:
   Pre-print: before being reviewed by pairs.
   Post-print: once reviewed by pairs, which can be:
The version of the author that has been accepted for publication.
The editor's version, that is, the article published in the magazine.
   At which point the article can be made accessible in an open manner: before it is published in the magazine, immediately afterwards or if a period of seizure is required, which can range from six months to several years.
Where to leave open: on the author's personal web page, only departmental websites, the repository of the institution, the file of the research funding agency, among others.

Author Biographies

Iryna Drozd, Taras Shevchenko National University of Kyiv

Doctor of Economics, Professor, Center of advanced training, Institute of postgraduate education, Taras Shevchenko National University of Kyiv (Ukraine). She is the Chairman of the Scientific and Expert Council at the State Treasury Service of Ukraine, a member of the Methodological Council on Accounting under the Ministry of Finance of Ukraine, the author of more than 110 scientific works. She has an experience in external and internal audit, accounting in the public sector of the economy. Scientific interests: external and internal audit, public procurement, government accounting and financial reporting.

Mariia Pysmenna, Flying Academy of National Aviation University

Doctor of Economics, Department of Management, Faculty of Management, Flying Academy of National Aviation University, (Ukraine). She is the Editor-in-Chief of the collection "Scientific Bulletin of the Flight Academy. Economics, Management and Law Series" from 2019, the author of more than 75 scientific works. She has an experience in the field of internal audit of the bank, management of corporate finance, public procurement. Scientific interests: public finance, control and analysis of the public procurement system, internal audit of banks, accounting and financial reporting.

Nataliia Pohribna, Taras Shevchenko National University of Kyiv

Ph.D. in Economics, Department of Finance, Faculty of Economics, Taras Shevchenko National University of Kyiv (Ukraine). She is the author of 65 scientific and educational works. She has experience in the field of financial management and financial analysis.

Scientific interests: professional ethics and standards of practice in finance, leadership and ethics in public sector, financial globalization, capital markets, financial stabilization of universities.

Nataliya Zdyrko, Vinnytsia National Agrarian University

Doctor of Science (Economics), Associate Professor, Dean of the Faculty of Accounting and Audit. She teaches disciplines taught: audit, public procurement control, computer audit, public financial control, control and audit. Scientific interests: public financial control, public audit, analysis and control of public procurement, international auditing standards. Author of more than 110 scientific works. ScopusID 57192835222

Anna Kulish , Kyiv National Economic University named after Vadim Hetman

Ph. D. in Economics, Professor of Accounting, Department of Corporate Finance and Controlling. She teaches disciplines: Corporate Finance, Financial management, Financial Analysis. Scientific interests: The Financial Analysis in the management of the enterprise, Strategic management, Financial management, Financial Controlling. Author of more than 99 scientific works.

References

Accounting Chamber (2019). Report on the analysis of the functioning of the public procurement system. Available: https://rp.gov.ua/upload-files/Activity/Collegium/2019/12-2_2019/Zvit_12-2_2019.pdf. Access: 1th April, 2020.

Accounting Chamber (2020). Information on «Savings» of UAH 28.2 billion in public procurement in 2019 is contradictory. Available: https://rp.gov.ua/PressCenter/News/?id=908. Access: 6th April, 2020.

Adi, S., & Dutil, P. (2018). Searching for strategy: Value for Money (VFM) audit choice in the new public management era. Canadian Public Administration, 10.1111/capa.12254, 61(1), (91-108). DOI: https://doi.org/10.1111/capa.12254.

Antoniuk, O., Chyzhevska, L., & Semenyshena, N. (2019). Legal regulation and trends of audit services: what are the differences (evidence of Ukraine). Independent Journal of Management & Production, 10(7), 673-686. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.903

Antoniuk, O., Kuzyk, N., Zhurakovska, I., Sydorenko, R., & Sakhno, L. (2020). The Role of «Big Four» Auditing Firms in the Public Procurement Market in Ukraine. Independent Journal of Management & Production, 11(9), 2483-2495. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1432.

Arrowsmith, S., Linarelli, J., & Don Wallace, JR. (2000). Regulating Public Procurement. National and International Perspectives. Kluwer Law International.

Beuve, J., Moszoro, M. W., & Saussier, S. (2018). Political contestability and public contract rigidity: An analysis of procurement contracts. Journal of Economics & Management Strategy. doi:10.1111/jems.12268.

Bowerman, M., Raby, H., & Humphrey, C. (2000). In Search of the Audit Society: Some Evidence from Health Care, Police and Schools. International Journal of Auditing, 4(1), 71–100. DOI:10.1111/1099-1123.00304.

Duncombe, W., & Searcy, C. (2007). Can the Use of Recommended Procurement Practices Save Money? Public Budgeting & Finance, 27(2), 68–87. DOI:10.1111/j.1540-5850.2007.00875.x.

Fesenko, V., Vakulchyk, O., Guba, O., Ostapchuk, S., & Babich, I. (2020). The Results of Implementation of European Requirements in Management of Transfer Pricing Audit (Experience of Ukraine). Independent Journal of Management & Production, 11(9), 2417-2434. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1412.

Goncharenko, L. P., & Filin, S. A. (2016). Risk management. Moscow: KNORUS.

Ivanova, O. V. (2010). Methodology for a comprehensive assessment of the effectiveness of public procurement of the Oryol region. Bulletin of TulSU. Economic and legal sciences, 2, 183-192.

Karlöf, B. (1996). New age efficiency and demands on organizations. Strategic Change, 5(1), 43–48. DOI:10.1002/(sici)1099-1697(199601)5:1<43::aid-jsc211>3.0.co;2-a.

Khorunzhak, N., Belova, I., Zavytii, O., Tomchuk, V., & Fabiianska, V. (2020). Quality Control of Auditing: Ukrainian Prospects. Independent Journal of Management & Production, 11(8), 712-726. DOI: dx.doi.org/10.14807/ijmp.v11i8.1229.

Khorunzhak, N., Brukhanskyi, R., & Ivanyshyn, V. (2019). Logic-statistical information models in control function of accounting. Independent Journal of Management & Production, 10(7), 846-871. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.906.

Kroll, Y., & Levy, H. (1980). Sampling Errors and Portfolio Efficient Analysis. Journal of Financial and Quantitative Analysis, 15(3), 655-688. DOI:10.2307/2330403.

Lambert-Mogiliansky, A., & Sonin, K. (2006). Collusive Market Sharing and Corruption in Procurement. Journal of Economics Management Strategy, 15(4), 883–908. doi:10.1111/j.1530-9134.2006.00121.x.

Lapin, A. E., Kiseleva, O.V., & Kumundzhieva, E. L. (2016). Approaches to assessing the effectiveness of the contract system in the field of state and municipal procurement. Business. Education. Right. Bulletin of the Volgograd Institute of Business, 11(34), 30-35.

MAPS (2018). Methodology for Assessing Procurement Systems. Available: http://www.mapsinitiative.org/methodology/MAPS-methodology-for-assessing-procurement-systems.pdf. Access: 18th June, 2020.

Mayne, J., & Ontario, O. (2006). Audit and evaluation in public management: challenges, reforms, and different roles. The Canadian Journal of Program Evaluation, 21(1), 11–45.

McCrae, M., & Vada, H. (1997). Performance Audit Scope and the Independence of the Australian Commonwealth Auditor‐General. Financial Accountability & Management, 13(3). DOI: https://doi.org/10.1111/1468-0408.00034.

Melnyk, N., Trachova, D., Kolesnikova, O., Demchuk, O., & Golub, N. (2020). Accounting Trends in the Modern World. Independent Journal of Management & Production, 11(9), 2403-2416. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1430.

Methodological (2008). Methodological recommendations for assessing the effectiveness and transparency of placing state and municipal orders. Moscow: Delovoy dvor.

Moncrieffe, J., & Luttrell, C. (2005). Аn analytical framework for understanding the political economy of sectors and policy arenas. Overseas Development Institute. Availiable: http://www.odi.org/sites/odi.org.uk/files/ odi-assets/publications-opinion-files/3898.pdf. Access: 1th MarchMay, 2020.

Nesterovich, N. V. (2008). N. 94-FZ: how to find savings. State order: Management, Placement, Provision. 12 (April, June), 32–35.

Pasko, O., Melnychuk, O., & Bilyk T. (2019). Ownership concentration, investor protection and economic performance in public agroindustrial companies with the listing on Warsaw stock exchange. Independent Journal of Management & Production, 10(7), 817-845. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.914.

Perov, K. A., Dashkov, S. B., & Abdrakhimov, D. A. (2006). Development of a methodology for calculating the economic efficiency of placing orders for the supply of goods, performance of work, provision of services for state and municipal needs: research report. Moskow: LTD Institute of Competitive Technologies.

Pollitt, C. (2013). The logics of performance management. Evaluation, 19(4), 346–363. DOI: https://doi.org/10.1177/1356389013505040.

Pollitt, C., Girre, X., Lonsdale, J., Mul, R., Summa, H., & Waerness, M. (1999). Performance or Compliance? Performance Audit and Public Management in Five Countries. Oxford: Oxford University Press.

Prozorro (2020). ProZorro is a hybrid electronic open source government e-procurement system. Available: https://prozorro.gov.ua/ Access: 5th June, 2020.

PUBLIC PROCUREMENT IN THE EU (2016). Public Procurement in the EU: Legislative Framework, Basic Principles and Institutions. Available: http://www.sigmaweb.org/publications/Public-Procurement-Policy-Brief-1-200117.pdf . Access: 1th November, 2018.

Pyismenna, M. (2017). Written by MS State audit and analysis of public procurement: theory, methodology and practice. Kyiv: Center for Educational Literature.

Rodrigues, P. C. C., & Semenyshena, N. (2019). Editorial Introduction. Independent Journal of Management & Production, 10(7), 911-914. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.775.

Rodrigues, P. C. C., & Semenyshena, N. (2020). Special Edition (Integration System of Education, Science and Production) Introduction. Independent Journal of Management & Production, 11(8), 801-806. DOI: http://dx.doi.org/10.14807/ijmp.v10i7.775

Rodrigues, P. C. C., Simanaviciene, Z., & Semenyshena, N. (2020). Editorial Volume 11, Issue 9. Independent Journal of Management & Production, 11(9), 2542-2547. DOI: http://dx.doi.org/10.14807/ ijmp.v11i9.1424

RPP (2015). Recommendation on Public Procurement: Public Procurement is the cornerstone of strategic governance. Available: http://www.oecd.org/gov/public-procurement/recommendation/OECD-Recommendation-on-Public-Procurement.pdf. Access: 24th April, 2020.

Semenyshena, N., Khorunzhak, N., & Zadorozhnyi, Z.-M. (2020). The Institutionalization of accounting: the impact of national standards on the development of economies. Independent Journal of Management & Production, 11(8), 695-711. DOI: https://doi.org/10.14807/ijmp.v11i8.1228.

Semenyshena, N., Sysiuk, S., Shevchuk, K., Petruk, I., & Benko, I. (2020). Institutionalism in Accounting: a Requirement of the Times or a Mechanism of Social Pressure? Independent Journal of Management & Production, 11(9), 2516-2541. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1440.

Shevchuk, V. O. (1998). Control of economic systems in a society in transition (problems of theory, organization, methodology). Kyiv: Kyiv State University of Trade and Economics.

Slobodyanik, Y., Kondriuk, L., & Haibura, Y. (2019). The Strategy of Institutional Reform of the Supreme Audit Institution: the Case of Ukraine. Independent Journal of Management & Production, 10(7). DOI: http://dx.doi.org/10.14807/ijmp.v10i7.916.

Sollish, F., & Semanik, J. (2012). The Procurement and Supply Manager's Desk Reference. Chapter 4 Supplier Selection Criteria Book Editor(s): Wiley. DOI: https://doi.org/10.1002/9781119205098.ch4.

Spiller, P., Reinecke, N., Ungerman, D., & Teixeira, H. (2013). Procurement 20/20: Supply Entrepreneurship in a Changing World. In: Chapter 7 The New Economic Drivers: Capturing the Total Impact of Environmental, Social, and Regulatory Factors, ch. 7. DOI: https://doi.org/10.1002/9781119204985.ch7.

Stupakov, V. S., & Tokarenko, G.S. (2005). Risk management. Moscow: Finance and Statistics.

Uncitral (2011). Model Law on Public Procurement. Available: https://uncitral.un.org/en/texts/procurement/modellaw/public_procurement. Access: 7th June, 2020.

Vdovenko, N., Piven, A., Radchenko, O., Sinenok, I., & Voskobiinyk, S. (2020). Institutional Environment for Financial Provision of Small Agricultural Business Entities of Ukraine. Independent Journal of Management & Production, 11(9), 2379-2402. DOI: http://dx.doi.org/10.14807/ijmp.v11i9.1419.

Waters, D. (2015). Logistics. Supply chain management. Logistics. An Introduction to Supply Chain Management. Moscow: UNITY-DANA.

White, G. R. T., Parfitt, S., Lee, C., & Mason-Jones, R. (2016). Challenges to the Development of Strategic Procurement: A Meta-Analysis of Organizations in the Public and Private Sectors. Strategic Change, 25(3), 285–298. DOI:10.1002/jsc.2061.

Zaiets, N. M. (2017). A pilot analysis of the procurement procedures. Bulletin of ZhDTU. Series: Economics of Science, 1(179), 72-80.

Article Sidebar

Main Article Content