Georgian Opinion Research Business International, Tbilisi, Georgia (GORBI) GORBI is the oldest and one of the largest market and opinion research organizations in Georgia. Founded by Dr Merab Pachulia (in partnership with Dr Gordon Heald, Director of Opinion Research Business, UK) it has earned a strong reputation, both regionally and internationally, for its impeccable research standards. Since its inception in 1991, GORBI has refined its techniques and broadened its scope to become the foremost survey research organization in the Caucasus. Over the last two decades, GORBI has worked with numerous organisations worldwide, and has conducted various projects focusing on politics, sociology, electoral studies, and social policy. GORBI’s work is often cited in major print and broadcast media, including The Financial Times, The Economist, The New York Times, The Los Angeles Times, La Figaro, and Newsweek, as well as major television networks. GORBI provides full-service research, offering a complete range of qualitative and quantitative research strategies, including surveys, focus groups, in-depth interviews, media monitoring, and desk research activities. In Georgia alone, GORBI employs more than 300 well-trained interviewers and supervisors with an average of 8 years’ experience, and has its presence in throughout the Caucasus. GORBI’s track record and management capabilities are reflected in the award of several multi-country projects conducted on behalf of the World Bank, EBRD, IFC and the EU over the last decade. These projects, implemented by GORBI in more than ten countries, have included the ‘Assessment of the ENPI, Business Environment and Enterprise Performance Survey’ (BEEPS), ‘Organization and Innovation survey’ (MOI), ‘Rural Investment Climate Assessment’ (RICA), ‘Life in Transition Survey’; and more recently ‘Social Accountability in Municipal Services in Georgia’ (2014); and ‘Missing Women in The South Caucasus’ (2014). Currently, GORBI, As a part of the consortia lead by TNS Opinion, is completing a 3-year Project in 6 countries (Ar, Az, Ge, Belarus, Moldova and Ukraine), the European Neighborhood Partnership Initiative (ENPI) Assessment in Georgia financed by the EU. Also, currently, GORBI conducts ‘Post Presidential Election survey in Uzbekistan (Political Science Department’, University of Wisconsin-Milwaukee and Harriman Institute, Columbia University and ‘Political and Economic Behavior in Georgia’, the University of Iowa. Dr Merab Pachulia is Managing Director of GORBI. A sociologist by training, he has supervised multiple national, regional, and international projects. From 1991 to 1994, Dr. Pachulia was in charge of the Eurobarometer surveys in Armenia and Georgia. He was also director of the World Values Surveys in the Caucasus in 1995 and of the same project in Georgia in 2008. He led the European Values Surveys across the Caucasus in 2008. In 1992, 1995, and 1999 on behalf of the UNICRI, he supervised opinion surveys concerning crime in Georgia and Azerbaijan. He was the team leader for a repeat survey (funded by EU) in Georgia in 2010 and 2011. Dr Pachulia undertook 2005 exit polls for the parliamentary elections in Azerbaijan; and conducted major rural and social assessment projects in Georgia for the World Bank in 2002, 2003 and in 2011. The latter cited his implementation as one of “the best practice” setting "an important standard for future projects.” His publications include:
Tea Chanturia was appointed as GORBI’s Project Manager in 2008. She has a B.A. degree in International Relations and Diplomacy as well as a Masters of Law. Tea has managed several projects for GORBI in the former Soviet bloc countries and has conducted extensive training with colleagues from Central Asia, the Caucasus and Eastern Europe. She mainly conducts public opinion polls among the general population. She managed projects:
Even before data collection is underway, we begin our data quality assurance routines. There are three primary methods we use to prevent data falsification and mis-entry. We use several checks at the point of entry, tools to check collected data for irregularities, as well as back-checking previously completed fieldwork. Any irregularities in data collection or problems uncovered during the course of fieldwork will be reported to the Pew Research team, along with recommendations for correction, and we will agree upon an appropriate response. On-site DQA - Our supervisors are our primary method of QA on site. Supervisors regularly and randomly visit interviews in progress to ensure that proper technique is observed, and that interviewers are professional and efficient. Secondly, our CAPI questionnaires are programmed to guarantee the proper formatting of entered data, and to carry out logical skips without requiring interviewer participation. Central DQA - At our HQ, we pair GPS readings with completed surveys to ensure that timing and location are consistent. We also perform logical checks of the collected data, and any inconsistent responses that may represent data falsification are flagged for review. Back-checking - Finally we will back-check 10% of all collected data to ensure that the repeated surveys are not inexplicably different than reported. This last step further encourages proper data collection by interviewers. Our software allows for recording of the actual interview via built-in microphones in laptops. We use this feature when conducting market research or other opinion polls. Any time this feature is turned on, we obtain consent/agreement from respondents. Naturally, this method dramatically increases the quality of data collection and especially the interviewing process, but the only drawback is ensuring respondents about the anonymity of their political preferences. We are most happy to discuss this approach with Pew Research and together decide the worthiness of this method for the project per offered country. Our Technology G-CAESS Capabilities - GORBI has over a hundred notebooks, netbooks, and tablets in Georgia that serve as hardware for our proprietary programs known collectively as “GORBI - Computer Assisted Entry Software Suite”. We developed this suite in-house to provide capabilities that other interviewing software was lacking: field data uploading, interview timing, an interface with our GPS devices, and a series of data quality assurance measures. The software suite includes a battery of quality assurance procedures both at the point of entry and in the database. These include: survey templates that check for appropriate character length and format, a series of logical checks on our servers that help to identify possible data falsification and mis-entry, and systematic comparison of interview times and entered locations with GPS readings allows us unrivalled oversight of our interviewers in the field and geospatial analysis capabilities as well. NB. In Georgia, we prefer using devices with an actual keyboard and 12inch screens at minimum, this has two advantages – the process is less time consuming, and users make fewer mistakes compared to entering answers via touch screen and special pen. Also, with large screens it is much easier to work on lengthy surveys and read tables. GPS-RAS - Over the four years, all fieldwork activities in Georgia have been tracked by our GPS-RAS (Global Positioning System - Route Analysis Solution). This system provides an extra measure of data quality, as well as the possibility to visualize and analyze data geographically. When using our GPS devices, human error is minimal as there are no buttons or interaction required; the process is automated. Regular readings are taken and analysis is conducted after the data is sent to our HQ and synchronized with our questionnaire data. Once paired, the data is run through our proprietary algorithms that validate all the data, generate error reports, and a map file that can be used with programs such as Google earth. This gives us a good understanding of interviewers’ behavior during the fieldwork, adds transparency to the interviewing process, and can provide organizations a means of determining if interviewers are following the methodologies assigned to the route. Previous Research Projects
Fieldwork Quality Control using GPS technology A few years ago, while conducting a WB household survey, it was requested that we take GPS readings of every household we approach. Since that time, GORBI has made GPS field tracking part of our standard data quality assurance package. GORBI has developed a system that provides a significant level of transparency regarding face to face interviews. This system allows GORBI to track interviewers as they conduct each interview, giving GORBI the ability to ensure that the methodology set for fieldwork is followed. GORBI uses a proprietary system which tracks interviews by GPS. By employing several algorithms, GORBI is able to generate an accurate portrait of the path taken in such detail that each interview can be traced to the street and house level. Collecting GPS readings Over the last four years, all of GORBI’s fieldwork activities in Georgia have been tracked by GPS devices. In late 2010, GORBI purchased over 400 (model 747A+) GPS devices for fieldwork from TSI. These devices were compared with several other brand name devices but eventually chosen for their simplicity. Each device is programmed in a way to collect readings every 10 seconds. The interviewer also has to make sure that the device is charged every three days. The rest of the process (analysing the readings to synchronize with questionnaire data) is done through our software. Its other advantage is security: as the device has no screen and looks like a simple pager, it is less likely to draw the attention of security forces in more sensitive locations (i.e. Uzbekistan, Tajikistan, Azerbaijan, Belarus). This device comes with software which allows us to export data to a simple comma delimited file. This provides simple integration with excel or any required RDBMS system including Oracle, Microsoft SQL Server, and MySQL, among others. GPS readings are uploaded to Google earth and used for measuring the random route of respondents. This is not a 100% precise approach, but it still gives us a good understanding of interviewers’ behaviour during fieldwork. |
NATIONAL PARTNERS >