Right Indicators of Urban Railway System: Combination of BSC and DEA Model

Document Type : Research Paper


1 Msc student, School of Industrial Engineering, Iran University of Science and Technology, Tehran, Iran

2 Assisstant Professor, School of Industrial Engineering, Iran University of Science and Technology, Tehran, Iran

3 Associate Professor, School of Industrial Engineering, Iran University of Science and Technology, Tehran, Iran


With the expansion of cities and ever-increasing traffic dilemma closely connected to people’s lives, public transportation has become one the essential needs of communities. Subway because of its benefits is an important part of our lives: alleviating urban transit pressure, high safety and reliability, mass transit capacity, low energy consumption, and low price. Therefore, its performance improvement led to increasing citizenry satisfaction seems essential. The most important point in evaluation and performance improvement is the proper selection of measures. The main purpose of this paper is to introduce a new approach for selection of right indicators. For this purpose, with respect to the cause and effect relationships in balanced scorecard, its measures are applied as input and output variables of three-stage data envelopment analysis model. At first, some indicators are supposed for each BSC’s aspects and the efficiency of all stages in this basic model is computed. Then, individual inputs are considered in each stage and the efficiency of that stage is computed again in order to compare with the efficiency score of the same stage in the basic model. With interpreting of efficiency variations in each stage, appropriate measures are determined. An experimental example which contains 10 stations of Tehran subway is provided to illustrate the implementation of this model. The results indicate that efficiency of train, concurrent consideration of average density per each passenger and waiting at the station, and simultaneous consideration of average density per each passenger and the delay per trip are appropriate measures. The proposed approach in this study helps to managers and decision makers in transportation industry to recognize right indices for performance improvement.


-Ahmed Mousa Ali, M. (2014) ‘‘Lessons for Policy Makers in Non-High Speed Rail Countries: A Review’’, International Journal of Transportation Engineering, Vol. 2, No. 4, pp. 323-338.
-Åhrén, T. and Parida, A. (2009) “Maintenance performance indicators (MPIs) for benchmarking the railway infrastructure: a case study’’, Benchmarking: An International Journal, Vol. 16, No. 2, pp. 247-258. ‏
-Åhrén, T., and Parida, A. (2009) “Overall railway infrastructure effectiveness (ORIE) A case study on the Swedish rail network’’, journal of quality in maintenance engineering, Vol. 15, No. 1, pp. 17-30.
-Alizadeh, H., Shahmoradi, B., Abdi, M. H. and Rahimi, A. (2014) “Developing Transit-oriented Strategies for Sanandaj City Center, Iran”, International Journal of Transportation Engineering, Vol. 1, No. 3, pp. 141-150.
-Aydin, N. (2017) “A fuzzy-based multi-dimensional and multi-period service quality evaluation outline for rail transit systems”, Transport Policy, Vol. 55, pp. 87-98.
-Aydin, N., Celik, E. and Gumus, A. T. (2015) “A hierarchical customer satisfaction framework for evaluating rail transit systems of Istanbul”, Transportation Research Part A: Policy and Practice, Vol. 77, pp. 61-81.
-Banker, R. D., Potter, G. and Srinivasan, D. (2000) “An empirical investigation of an incentive plan that includes nonfinancial performance measures”, The accounting review, Vol. 75, No. 1, pp. 65-92.
-Bento, A., Bento, R. and White, L. F. (2013) “Validating cause-and-effect relationships in the balanced Fscorecard”, Academy of Accounting and Financial Studies Journal, Vol. 17, No. 3, pp. 45. ‏
-Boame, A. K. (2004) “The technical efficiency of Canadian urban transit systems”, Transportation Research Part E: Logistics and Transportation Review, Vol. 40, No. 5, pp. 401-416.
-Chen, F. H., and Tzeng, G. H. (2014) “Probing organization performance using a new hybrid dynamic MCDM method based on the balanced scorecard approach”, Journal of Testing and Evaluation, Vol. 43, NO. 4, pp. 924-937.
-Costa, Á., and Markellos, R. N. (1997) “Evaluating public transport efficiency with neural network models”, Transportation Research Part C: Emerging Technologies, Vol. 5, No. 5, pp. 301-312.
-Famurewa, S. M., Stenström, C., Asplund, M., Galar, D. and Kumar, U. (2014) “Composite indicator for railway infrastructure management”, Journal of Modern Transportation, Vol. 22, No. 4, pp. 214-224.
-Färe, R. and Grosskopf, S. (2000) “Network DEA”, Socio-Economic Planning Sciences, Vol. 34, No. 1, pp. 35-49.
-García Valderrama, T., Revuelta Bordoy, D. and Rodríguez Cornejo, V. (2013) “Balanced Scorecard and Efficiency: Desing and Empirical Validation of strategic Map in the University by Means of DEA”.
-Ghotbuee, A., Hemati, M. and Fateminezhad, R. (2012) “An empirical study based on BSC-DEA to measure the relative efficiencies of different health care centers in province of Semnan, Iran”, Management Science Letters, Vol. 2, No. 7, pp. 2643-2650.
-Hong, L., Yan, Y., Ouyang, M., Tian, H. and He, X. (2017) “Vulnerability effects of passengers' intermodal transfer distance preference and subway expansion on complementary urban public transportation systems” Reliability Engineering & System Safety, Vol. 158, pp. 58-72.
-Ittner, C. D. and Larcker, D. F. (1998) “Are nonfinancial measures leading indicators of financial performance? An analysis of customer satisfaction”, Journal of accounting research, Vol. 36, pp. 1-35.
-Kao, C. (2009) “Efficiency measurement for parallel production systems”, European Journal of Operational Research, Vol. 196, No. 3, pp. 1107-1112.
-Kaplan, R. S. and Norton, D. P. (1992) “The Balanced Scorecard--Measures That Drive Performance”, Harvard Business Review, Vol. 70, No. 1, pp. 71-79.
-Kaplan, R. S. and Norton, D. P. (1996) “The balanced scorecard: translating strategy into action. Harvard Business Press”. ‏
-Kaplan, R. S. and Norton, D. P. (2004) “The strategy map: guide to aligning intangible assets”, Strategy & Leadership, Vol. 32, No. 5, pp. 10-17. ‏
-Lan, L. W. and Lin, E. T. (2005) “Measuring railway performance with adjustment of environmental effects, data noise and slacks”, Transportmetrica, Vol. 1, No. 2, pp. 161-189.
-Lan, L. W. and Lin, E. T. (2006) “Performance measurement for railway transport: stochastic distance functions with inefficiency and ineffectiveness effects”, Journal of Transport Economics and Policy (JTEP), Vol. 40, No. 3, pp. 383-408.
-Lawrence, W. and Erwin, T. (2003) “Technical efficiency and service effectiveness for railways industry: DEA approaches”, Journal of the Eastern Asia Society for Transportation Studies, 5.
-Leung, L. C. Lam, K. C. and Cao, D. (2006) “Implementing the balanced scorecard using the analytic hierarchy process & the analytic network process”, Journal of the Operational Research Society, Vol. 57, No. 6, pp. 682-691. ‏
-Lewis, H. F. and Sexton, T. R. (2004) “Network DEA: efficiency analysis of organizations with complex internal structure”, Computers & Operations Research, Vol. 31, No. 9, pp. 1365-1410.
-Liang, C. J. and Hou, L. C. (2007) “A dynamic connection of balanced scorecard applied for the hotel”, Journal of Services Research, Vol. 7, NO. 1, pp. 91.
-Lucianetti, L. (2010)” The impact of the strategy maps on balanced scorecard performance”, International Journal of Business Performance Management, Vol. 12, No. 1, pp. 21-36.
-Maina, E.V., Forda, A. and Rabinson, R.M. (2016) “Impact of Optimally Minimizing Delay Times on Safety at Signalized Intersections in Urban Areas, Case Study: The City of Virginia Beach”, International Journal of Transportation Engineering, Vol.3, No. 4, pp. 277-288.
-Malhotra, R., Malhotra, D. K. and Lermack, H. (2009) “Using data envelopment analysis to analyze the performance of North American class I freight railroads” In Financial Modeling Applications and Data Envelopment Applications, Emerald Group Publishing Limited, pp. 113-131.
-Mallikarjun, S., Lewis, H. F. and Sexton, T. R. (2014) “Operational performance of US public rail transit and implications for public policy”, Socio-Economic Planning Sciences, Vol. 48(1), pp. 74-88.
-Manasakis, C., Apostolakis, A., and Datseris, G. (2013) “Using data envelopment analysis to measure hotel efficiency in Crete”, International Journal of Contemporary Hospitality Management, Vol.25, No. 4, pp. 510-535. ‏
-Murali, S., and Pugazhendhi, S. (2016) “An integrated model to identify and rank the after sales service strategies of firms engaged in household appliances business”, International Journal of Services and Operations Management, Vol.24, NO. 1, PP. 99-124.
-Nathanail, E. (2008) “Measuring the quality of service for passengers on the Hellenic railways”, Transportation Research Part A: Policy and Practice, Vol. 42, No. 1, pp. 48-66.
-Nesterova, N. S., Goncharuk, S. M., Anisimov, V. A., and Anisimov, A. V. (2016) “Strategy development management of Multimodal Transport Network”, In MATEC Web of Conferences, Vol. 86, p. 05024, EDP Sciences.
-Pan, J. N., and Nguyen, H. T. N. (2015) “Achieving customer satisfaction through product–service systems”, European Journal of Operational Research, Vol. 247, No. 1, pp. 179-190. ‏
-Powell, J. P., González-Gil, A., and Palacin, R. (2014) “Experimental assessment of the energy consumption of urban rail vehicles during stabling hours: influence of ambient temperature”, Applied Thermal Engineering, Vol. 66, No. 1, pp. 541-547.
-Qin, F., Zhang, X., and Zhou, Q. (2014) “Evaluating the impact of organizational patterns on the efficiency of urban rail transit systems in China”, Journal of Transport Geography, Vol. 40, pp. 89-99.
-Rassafi, A.A., Ostad Jafari, M. and Javanshir, H. (2014) “An Appraisal of Sustainable Urban Transportation: Application of a System Dynamics Model”, International Journal of Transportation Engineering, Vol. 2, No. 1, pp. 47-66.
-Sangtarash, L. (2012) “Performance evaluation (performance) subway stations, using a combination of balanced scorecard and data envelopment analysis”, Master’s thesis, Iran University of Science and Technology.
-Sexton, T. R. and Lewis, H. F. (2003) “Two-stage DEA: An application to major league baseball”, Journal of Productivity Analysis, Vol. 19, No. (2-3), pp. 227-249.
-Shafiee, M., Lotfi, F. H. and Saleh, H. (2014) “Supply chain performance evaluation with data envelopment analysis and balanced scorecard approach”, Applied Mathematical Modelling, Vol. 38, No. 21, pp. 5092-5112.
-Shapouri, F. and Keramati, A. (2015) “A framework for constructing customer relationship management strategy map based on multiple criteria decision-making approach”, International Journal of Electronic Customer Relationship Management, Vol. 9, NO. 2-3, PP. 175-188.
-Shen, W., Xiao, W. and Wang, X. (2016) “Passenger satisfaction evaluation model for Urban rail transit: A structural equation modeling based on partial least squares”, Transport Policy, Vol. 46, pp. 20-31.
-Stenström, C., Parida, A. and Galar, D. (2014) “Performance indicators of railway infrastructure”, The international Journal of railway technology, Vol. 1, No. 3, pp. 1-18.
-Stenström, C., Parida, A. Galar, D., and Kumar, U. (2013) “Link and effect model for performance improvement of railway infrastructure”, Proceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit, Vol. 227, No. 4, pp. 392-402.
-Titko, J., Stankevičienė, J. and Lāce, N. (2014) “Measuring bank efficiency: DEA application”, Technological and Economic Development of Economy, Vol. 20, No. 4, pp. 739-757. ‏
-Tsai, Y. C. and Cheng, Y. T. (2012) “Analyzing key performance indicators (KPIs) for E-commerce and Internet marketing of elderly products: A review”, Archives of gerontology and geriatrics, Vol. 55, No. 1, pp. 126-132. ‏
-Varmazyar, M., Dehghanbaghi, M. and Afkhami, M. (2016) “A novel hybrid MCDM model for performance evaluation of research and technology organizations based on BSC approach”, Evaluation and Program Planning, Vol. 58, pp. 125-140.
-Wanke, P., Barros, C. P. and Figueiredo, O. (2016) “Efficiency and productive slacks in urban transportation modes: A two-stage SDEA-Beta Regression approach”, Utilities Policy, Vol. 41, pp. 31-39.
-Wu, H. Y., Tzeng, G. H. and Chen, Y. H. (2009) “A fuzzy MCDM approach for evaluating banking performance based on Balanced Scorecard”, Expert Systems with Applications, Vol. 36, No. 6, pp. 10135-10147.
-Yaghoobi, T., Yaghoobi, T. Haddadi, F., and Haddadi, F. (2016) “Organizational performance measurement by a framework integrating BSC and AHP”, International Journal of Productivity and Performance Management, Vol. 65, NO. 7, pp. 959-976.
-Yao, J. and Liu, J. (2016) “E-Government Project Evaluation: A Balanced Scorecard Analysis”, Journal of Electronic Commerce in Organizations (JECO), Vol. 14, NO. 1, pp. 11-23.
-Yu, M. M. (2008) “Assessing the technical efficiency, service effectiveness, and technical effectiveness of the world’s railways through NDEA analysis” Transportation Research Part A: Policy and Practice, Vol. 42, No. 10, pp. 1283-1294.