{"id":68675,"date":"2012-10-20T12:00:49","date_gmt":"2012-10-20T15:00:49","guid":{"rendered":"http:\/\/revistapesquisa.fapesp.br\/?p=68675"},"modified":"2016-03-29T16:34:03","modified_gmt":"2016-03-29T19:34:03","slug":"research-as-a-basis-for-policy","status":"publish","type":"post","link":"https:\/\/revistapesquisa.fapesp.br\/en\/research-as-a-basis-for-policy\/","title":{"rendered":"Research as a Basis for Policy"},"content":{"rendered":"

\"\"GABRIEL BITTAR<\/span>The Audit Court of the State of Mato Grosso (TCE\/MT) monitors spending on education and health in 141 municipalities and the impact of these policies on the quality of services rendered to citizens through georeferenced databases developed by the Center for Metropolitan Studies (CEM). \u201cThis model allows us not only to assess whether municipalities are spending what the constitution requires, but also whether their performance has been improving,\u201d says Marta Arretche, a professor in the Political Science Department of the University of S\u00e3o Paulo (USP) and director of the CEM.<\/p>\n

The methodology, created five years ago at the request of the TCE\/MT, was transferred to the state and began to be used as a tool for evaluating the performance of municipal administrations. The information resulting from the application of the model, the Health and Education Performance Index for the cities of Mato Grosso, is available on the TCE\/MT web site and can be accessed by any citizen interested in obtaining information about spending and services in these areas in their municipality.<\/p>\n

Communicating the results of policy assessments is the primary mission of the CMS, one of the Research, Innovation and Dissemination Centers (RIDCs) supported by FAPESP (S\u00e3o Paulo Research Foundation) and established by the Brazilian Center for Analysis and Planning (CEBRAP) and the USP School of Philosophy, Letters and Humanities (FFLCH) and School of Communication and Arts (ECA). Since its inception in 2003, over 30 research projects have been implemented that involve methodology transfer to the public sector.<\/p>\n

The partnership between the TCE\/MT and the CEM began in 2007, when the court decided to conduct an investigation that went beyond checking the appropriateness of public spending, including analyses of legality, legitimacy and economic viability. \u201cThe court also felt that we needed to assess whether spending had a positive impact on society,\u201d says Volmar Bucco Jr., a public auditor at the TCE\/MT. This investigation gave rise to the notion of evaluating public policies using performance indicators, and the court signed a partnership agreement with the CEM. \u201cThis is a valuable tool. Through the portrayal of the results of public policies on health and education in the state and its municipalities, the efficient management of public resources can be evaluated through external control,\u201d he explains. Thus, the government can assess its own performance by evaluating progress and results compared to the Brazilian average. This facilitates decision making, and citizens can monitor the performance of public officials and demand improved services.<\/p>\n

\"110-113_Ciencias<\/a>The Health and Education Performance Index is actually a georeferenced database with information provided by the ministries of education and health and permits a comparison of the performance levels of different Brazilian municipalities. The assessment matrix considers 10 items for each of the areas in question. The analysis of health systems, for example, tallies neonatal mortality, health coverage for pregnant women, children\u2019s health indicators, deaths from infectious contagious diseases (such as dengue fever and tuberculosis) and the number of women\u2019s health visits. The data are collected by the Unified Health Care System database (Datasus). The information used to analyze the education system was collected on grade repetition rates up to the 4th grade and for the 5th to 8th grades, among other data. The National Institute for Educational Studies and Research (INEP) and the School Census (systems for evaluation of basic education in Brazil) provided this information.<\/p>\n

National Data <\/strong>
\nThe maps on the right and on page 113, for example, allow us to compare the performance of the health and educational systems in different municipalities throughout the country. The reddish areas indicate situations that are classified as \u201cvery bad.\u201d Dark blue areas represent circumstances rated as \u201cvery good.\u201d These two tones and the color gradient between them consolidate data collected at the municipal level from across the country.<\/p>\n

According to Marta Arretche, this type of analysis was only possible because the country has comprehensive and free public information systems. \u201cTo learn how the municipal or state governments are spending, you need to build a reliable system. And this information already exists. Only Japan compares to Brazil in terms of the availability of information on public systems. \u201cIn the United States,\u201d she adds, \u201cthere are no national information systems containing city data. There, to assemble a similar system one would need to go city by city, collect the desired information, then standardize it. Here we have the School Census, the Brazil Exam, Datasus, and the Brazilian Institute of Geography and Statistics (IBGE) municipal information surveys.\u201d<\/p>\n

This information must be standardized to permit comparisons. For each indicator, the municipality receives a score from 0 to 1. The indicator scores are summed to obtain the total score. The conditions are always analyzed for three-year periods (the maps are for the periods 2004\u20132006 and 2007\u20132009). \u201cWe work with a three year average because, if an extreme event were to occur in a city in a given year, for example, distortions could be corrected.\u201d<\/p>\n

The result of the comparative analyses for the period reveals that, in education, a substantial number of municipalities exhibited extremely poor performance at the beginning of the decade, while a small number of cities represented \u201cislands of excellence\u201d that have increased in size over the decade. Conversely, the Brazilian health sector does not exhibit these contrasts. \u201cThere is less inequality between municipalities, but we have no points of excellence, even though significant improvements have been seen over the years,\u201d says Arretche.<\/p>\n

The quality of life indicator <\/strong>
\nThe expectation of the TCE\/MT\u2019s public auditor is that this analytical methodology should be made available to any public agency in Brazil, or even to private ones. According to Marta Arretche, the study may help measure the degree of economic development and quality of life provided to the population of a country the size of Brazil. In her opinion, the Human Development Index (HDI) does not represent a good tool for the assessment of decentralized public service delivery systems. Because the CEM methodology permits much more comprehensive and realistic evaluations of the performance of health and education policies, it supports the development of more precisely targeted public policies that will have more substantial effects on the affected population.<\/p>\n

\"110-113_Ciencias<\/a>Mato Grosso, for example, is beginning to see results. The diagnostic indicators consolidated by this system have already resulted in improvements statewide. \u201cSince the TCE\/MT began using this methodology to assess the accounts of public administrative officials as well, societal control has intensified and the tool has begun to show the status of each municipality compared with others,\u201d he explains. \u201cGovernment officials then had to take steps to improve their indices.\u201d<\/p>\n

The successful implementation of the methodology had other outcomes: the CEM was asked to develop a panel for monitoring the number of homicides for the state Secretary of Public Safety, based on a set of indicators that measure the performance of security actions and also allow comparisons among different regions in the state. The panel serves as a sort of alarm whenever it registers negative changes in the average indicators.<\/p>\n

\u201cThis information methodology has become an important tool for assessing and supporting the formulation of public policy,\u201d said Eduardo Marques, a CEM researcher and professor in the USP Political Science Department. The CEM has conducted over 30 studies focused on providing support the formulation and implementation of public policies. Among these are a Map of Social Vulnerability, which allowed deficiencies to be detected by analyzing the distribution of socioeconomic structures, and Environmental indicators and urban management: sustainability challenges in the city of S\u00e3o Paulo, which enabled the administration to identify the substantial variability in environmental problems and pressures in different urban spaces; both of these studies concerned the City of S\u00e3o Paulo. Two other studies conducted for S\u00e3o Paulo concerned housing vulnerability, which were used to develop the city\u2019s Housing Plan. This last experience led the Ministry of Cities to commission the development of a methodology for the analysis of shantytowns, which generated information about the housing needs of a selected group in 560 municipalities.<\/p>\n

Partnerships with public agencies developed gradually through contacts between managers. \u201cThe CEM was one of the first to digitalize databases,\u201d says Marques. \u201cWe started with the city of Mau\u00e1 in 2003. The information circulates, and demands arise.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"Academic studies increasingly help governments adopt solutions","protected":false},"author":153,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"footnotes":""},"categories":[165],"tags":[256,261],"coauthors":[469],"class_list":["post-68675","post","type-post","status-publish","format-standard","hentry","category-humanities","tag-public-policies","tag-sociology"],"acf":[],"_links":{"self":[{"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/posts\/68675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/users\/153"}],"replies":[{"embeddable":true,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/comments?post=68675"}],"version-history":[{"count":0,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/posts\/68675\/revisions"}],"wp:attachment":[{"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/media?parent=68675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/categories?post=68675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/tags?post=68675"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/revistapesquisa.fapesp.br\/en\/wp-json\/wp\/v2\/coauthors?post=68675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}