Google Schola Metrics 2014: a low cost bibliometric tool - arXiv

5 downloads 189 Views 607KB Size Report
Jul 8, 2014 - bibliometric tool, and propose a list of features it should incorporate in order to stop being labeled as ... scientists can only be pleased about this variety of search and ranking tools, ...... Conference on Empirical Methods in Natural Language Processing (EMNLP). 53 ..... arXiv Optimization and Control (math.
EC3 Working Papers 17

Google Scholar Metrics 2014: a low cost bibliometric tool Alberto Martín-Martín 1, Juan Manuel Ayllón 1, Enrique Orduña-Malea2, Emilio Delgado López-Cózar1 2

1 EC3: Evaluación de la Ciencia y de la Comunicación Científica, Universidad de Granada (Spain) EC3: Evaluación de la Ciencia y de la Comunicación Científica, Universidad Politécnica de Valencia (Spain)

ABSTRACT We analyse the main features of the third edition of Google Scholar Metrics (GSM), released in June 2014, focusing on its more important changes, strengths, and weaknesses. Additionally, we present some figures that outline the dimensions of this new edition, and we compare them to those of previous editions. Principal among these figures are the number of visualized publications, publication types, languages, and the maximum and minimum h5index and h5-median values by language, subject area, and subcategory. This new edition is marked by continuity. There is nothing new other than the updating of the time frame (20092013) and the removal of some redundant subcategories (from 268 to 261) for English written publications. Google has just updated the data, which means that some of the errors discussed in previous studies still persist. To sum up, GSM is a minimalist information product with few features, closed (it cannot be customized by the user), and simple (navigating it only takes a few clicks). For these reasons, we consider it a “low cost” bibliometric tool, and propose a list of features it should incorporate in order to stop being labeled as such. Notwithstanding the above, this product presents a stability in its bibliometric indicators that supports its ability to measure and track the impact of scientific publications. KEYWORDS Google Scholar / Google Scholar Metrics / Journals / Citations / Bibliometrics / H Index / Evaluation / Rankings

EC3’s Document Series: EC3 Working Papers, 17 Document History Version 1.0, Published on 8 July 2014, Granada Cite as: Martín-Martín, A.; Ayllón, J.M.; Orduña-Malea, E.; Delgado López-Cózar, E. (2014). Scholar Metrics 2014: a low cost bibliometric tool. EC3 Working Papers, 17: 8 July 2014.

Google

Corresponding author: Emilio Delgado López-Cózar. [email protected]

1

EC3 Working Papers 17

1. WHAT IS NEW IN GOOGLE SCHOLAR METRICS 2014? No surprises. Almost with the punctuality of a fine Swiss watch, Google released, on June the 26th, 2014 1, its ranking of scientific publications: Google Scholar Metrics (GSM). Last year’s version was published a bit later in the summer, on July the 24th, 2013. Google has stopped being different: it seems that from now on, these coveted lists of publications sorted by their scientific impact (that is, their h index) will be released every summer, whether it is on June, like this year, or July, like last year. This means that GSM: Google Scholar Metrics will join its competitors JCR (Journal Citation Reports) and SJR (Scimago Journal Rank) in updating the product on a yearly basis. We can only welcome that the American company has decided to keep supporting GSM, a free product which is also very different from traditional journal rankings. This support might very well dispel the concerns about the continuity of its big brother, Google Scholar. Competition is healthy, and scientists can only be pleased about this variety of search and ranking tools, especially when they are offered free of charge. Continuity and stability are the norm in this edition, since there is nothing new except for the removal of some subcategories (from 268 to 261) for English written publications. In short, Google has just updated the data, which means that some of the errors outlined in previous studies still persist [1-5]: the visualization of a limited number of publications (100 for those that are not published in English), the lack of categorization by subject areas and subcategories for non-English publications, and normalization problems (unification of journal titles, problems in the linking of documents, and problems in the search and retrieval of publication titles). As an example, it is inexcusable that there are duplicates to be found in a ranking of the top 100 publications (according to their h5-index) of a particular language. This is the case with the journal 日本機械学会論文集 C 編, which appears in the 42nd and 69th positions in the Japanese rankings, and in the Portuguese ranking, Pesquisa Agropecuária Brasileira appears in the 15th and 22nd positions, Revista Brasileira de Engenharia Agrícola e Ambiental in the 25th and 37th positions, and Revista brasileira de atividade física e saúde in the 91st and 93rd. In our previous studies, we have described again and again the underlying philosophy embedded in all of Google’s academic products. These products have been created in the image and likeness of Google’s general search engine: fast, simple, easy to use, understand and, last but not least, accessible to everyone free of charge. GSM follows all these precepts, and it is, in the end, nothing more than: -

-

1

A hybrid between a bibliometric tool (indicators based on citation counts), and a bibliography (a list of highly cited documents, and of the documents that cite them). It offers a simple, straightforward journal classification scheme (although it also includes some conferences and repositories).

http://googlescholar.blogspot.com.es/2014/06/2014-scholar-metrics-released.html

2

Google Scholar Metrics 2014: a low cost bibliometric tool

-

-

-

-

It is based on two basic bibliometric indicators (the h index, and the median number of citations for the articles that contribute in the h index). It covers a single five-year time frame (the current one being 2009-2013). It uses rudimentary journal inclusion criteria, namely: publishing at least 100 articles during the last five-year period, and having received at least one citation. It provides lists of publications according to the language their documents are written in. For all of them, except for English publications (these are a total of 8: Chinese, Portuguese, German, Spanish, French, Japanese, Dutch, and Italian) it offers lists of only 100 titles: those with the higher h index. For English publications, however, it shows a total of 18 different publications, grouped in 8 subject areas and 261 subcategories. For each publication it shows the titles of the documents whose citations contribute to the h index, and for each one of these documents, in turn, the titles of the documents that cite them. It provides a search feature that, for any given set of keywords, will retrieve a list of 20 publications whose titles contain the selected keywords. In the cases where there are more than 20 publications that satisfy the query, only the first 20 results (those with a higher h index), will be displayed. It doesn’t perform any kind of quality control in the indexing process nor in the information visualization process.

To sum up, GSM is a minimalist information product with few features, closed (it cannot be customized by the user), and simple (navigating it only takes a few clicks). If GSM wants to stop being labeled as a “low cost bibliometric tool”, it should incorporate a wider range of features. At the very least, it should: -

-

-

-

Display the total number of publications indexed in GSM, as well as their countries and language of publication. Our estimations lead us to believe that this figure is probably higher than 40,000 [5]. In the case of Spain, there are over 1,000 publications indexed, which make up about 45% of the total number of academic publications in Spain [6, 7]. Provide some other basic and descriptive bibliometric indicators, like the total number of documents published in the journals indexed in GSM, and the total number of citations received in the analysed time frame. These are the two essential parameters that make it possible to assess the reliability and accuracy of any bibliometric indicator. Other indicators could be added in order to elucidate other issues like self-citation rates, impact over time (immediacy index), or to normalize results (citation average). Provide the complete list of documents of any given publication that have received n citations and especially those that have received “0” citations. This would allow us to verify the accuracy of the information provided by this product. It is true, much to Google’s credit, that this information could be extracted, though not easily, from Google Scholar. Provide a detailed list of the conferences and repositories included in the product. The statement Google makes about including some conferences in the Engineering & Computer Science area, and some

3

EC3 Working Papers 17

-

-

-

-

-

document collections like the mega-repositories arXiv, RePec and SSRN, is much too vague. Define the criteria that has been followed for the creation of the classification scheme (areas and subcategories), and the rules and procedures followed when assigning publications to these areas and subcategories. Enable the selection of different time frames for the calculation of indicators and the visualization and sorting of publications. The significant disparities in publishing processes and citation habits between areas (publishing speed, pace of obsolescence) require the possibility to customize the time frame according to the particularities of any given subject area. Enable access to previous versions of Google Scholar Metrics (20072011, 2008-2012) to ensure that it is possible to assess the evolution of publications over time. Moreover, they could dare venture into the unknown and do something no one else has done before: a dynamic product, with indicators and rankings updated in real-time, just as Google Scholar does. Enable browsing publications by language, country and subcategory, and directly display all results for these selections. Remove visualization restrictions: currently 100 results for each language and 20 for each subcategory or keyword search. Enable the visualization of results by country of publication and by publisher. Enable sorting results according to various criteria (publication title, country, language, publishers), as well as according to other indicators (h index, h median, number of documents per publication, number of citations, self-citation rate…). Enable searching not only by publication title, but also by country and language of publication. Enable an option for exporting global results, as well as results by discipline, or those of a custom query. Enable an option for reporting errors detected by users, so they can be fixed (duplicate titles, erroneous titles, incorrect links, deficient calculations…).

2. GOOGLE SCHOLAR METRICS 2014 IN NUMBERS Below we offer some data with the goal of shedding some light over the dimensions of this new edition of GSM and its differences, in quantitative terms, with previous versions of the product. 2.1. Publications visualized through GSM rankings The total number of publications that can be visualized in the 2014 rankings is 7,100. Now, however, since 1,338 of them (24.7%) are classified in more than one subject area (Table 1), the number of unique publications is lower: 5,418.

4

Google Scholar Metrics 2014: a low cost bibliometric tool

Table 1 Distribution of publications according to number of assigned subcategories in Google Scholar Metrics 2014 Publications Nº of subcategories N % 1 4,100 75.7 2 1,131 20.9 3 125 2.3 4 51 0.9 5 6 0.1 6 5 0.1 Total 5,418 100.0

In 2014 there is a slight drop in the number of publications if we compare it with the previous edition (2008-2012), where 7,171 publications could be visualized in the rankings (5,462 unique publications). 2.2. Languages of visualized publications in GSM rankings GSM rankings show an overwhelming skew towards the English language [8]: in this edition, the rankings show a total of 4,435 English-written publications (89%), and only 983 written in other languages, namely Chinese, Portuguese, German, Spanish, French, Italian, Japanese and Dutch (Figure 1). For all these languages, only 100 publications are shown in the language rankings, except in the case of Dutch publications, where only 83 items are shown. Figure 1 Distribution of publications according to languages in the Google Scholar Metrics 2014 rankings

2%

1% 2% 2%

1% 1% 1%1% English Chinese Portuguese German Spanish French Italian Japanese Dutch 89%

5

EC3 Working Papers 17

2.3. Types of publications visualized in GSM rankings The predominant type of publication in the GSM rankings is the scientific journal: up to 5,068 of the total of 5,418 visualized publications (93.5%) belong to this type of publication (Figure 2). Figure 2 Distribution of publications according to the type of source in the Google Scholar Metrics 2014 rankings

Repositories

Conferences 2%

Journals

4%

94%

As is apparent from Table 2, if we compare the current version of the product with the last version (2008-2012), there haven’t been any significant changes in the share each type of source holds. Table 2 Distribution of publications according to the type of source in Google Scholar Metrics rankings 2008-2012 and 2009-2013 Publications Sources 2008-2012 % 2009-2013 % Repositories 115 2.1 118 2.2 Conferences 241 4.4 232 4.3 Journals 5,107 93.5 5,068 93.5 Total 5,463 100 5,418 100

Conferences only make up 4.3% (232) of the visualized publications in the rankings. For the complete list of conferences, see Appendix 1. They are mostly concentrated in the Computer Science area, especially in subcategories like Computational Linguistics, Computer Hardware Design, Computer Networks & Wireless Communication, Computer Security & Cryptography, Computer Vision & Pattern Recognition, Computing Systems, Data Mining & Analysis, and Databases & Information Systems (Table 3).

6

Google Scholar Metrics 2014: a low cost bibliometric tool

The third type of publication indexed in GSM is the repository, whose inclusion has not been without certain controversy [9]. Repositories are digital storehouses with very wide subject coverage, created to save and disseminate very diverse academic materials. Because of the multidisciplinary nature of repositories, they shouldn’t be compared to scientific journals and conferences, since each of the latter deals, generally, with much narrower fields of study (a subcategory or specialty) and because the documents they contain must endure a much stricter scientific review process in order to be selected for publication. There are 118 visualized publications (2.2%) that belong to this type. Appendix 2 contains the complete list of visualized repositories. These publications are collections of documents that have been identified inside a repository, and they serve as the basis for the calculation of the bibliometric indicators. Most of them come from arXiv, RePec and SSRN, and are concentrated in the areas of Physics, Engineering and Economics (Table 3). Table 3 Distribution of publications according to type and subject area Google Scholar Metrics rankings 2008-2012 and 2009-2013 REPOSITORIES CONFERENCES Areas (English) Business, Eco. & Manag. Chemical & Material Sci. Eng. & Computer Sci. Health & Medical Sci. Humanities, Lit. & Arts Life Sciences & Earth Sci. Physics & Mathematics Social Sci.

20082012 41 1 23 0 5 6 78 20

% 11.5 0.2 1.9 0.0 0.9 0.7 14.8 1.9

20092013 33 1 25 0 5 7 78 20

% 9.7 0.2 2.1 0.0 0.9 0.9 15.6 1.9

20082012 5 0 244 1 1 3 21 5

% 1.4 0.0 20.4 0.1 0.2 0.4 4.0 0.5

20092013 4 1 229 2 1 4 19 1

% 1.2 0.2 19.4 0.1 0.2 0.5 3.9 0.1

20082012 310 417 929 1,444 574 823 429 1,013

JOURNALS % 87.3 99.8 77.7 99.9 99.0 98.9 81.2 97.7

20092013 303 398 926 1,396 534 789 403 1,039

% 89.1 99.5 78.5 99.9 98.9 98.6 80.6 98.0

2.4. Classification scheme: areas and subcategories in GSM As we pointed above, the only change introduced in the current version of GSM is the removal of a number of subcategories. There haven’t been any changes in the eight broad subject areas (not in their designation nor in their size). The areas that contain a larger number of subcategories are (Table 4): Health & Medical Sciences (69), Engineering & Computer Science (58) and Social Sciences (52). On the other hand, those with the lower number of subcategories are Business, Economics & Management (16) and Chemical & Material Sciences (19). As can be seen in Table 4, the modifications introduced in this edition are the removal of a certain number of redundant subcategories across all areas, with the exception of Social Sciences, where we can actually find two more subcategories, which are: Bioethics and Sociology.

7

EC3 Working Papers 17

Table 4 Number of subcategories by subject area Google Scholar Metrics 2008-2012 and 2009-2013 Nº of subcategories Subject Areas 2008-2012 2009-2013 Physics & Mathematics 26 24 Chemical & Material Sciences 20 19 Engineering & Computer Science 59 58 Health & Medical Sciences 72 69 Life Sciences & Earth Sciences 41 39 Humanities, Literature & Arts 28 26 Business, Economics & Management 17 16 Social Sciences 50 52 TOTAL 287 269

It is important, however, to note that the number of unique subcategories is lower than the summation of subcategories in the eight aforementioned areas. This is so because some subcategories are included in more than one subject area. Particularly, this phenomenon is present in 44 subcategories in the 20082012 version of GSM, and in 42 subcategories in the current 2009-2013 version (Table 5). If these duplicates are not taken into account, the total number of unique subcategories for the 2008-2012 version is 268 subcategories, and 261 for the current version. Table 5 List of duplicate subcategories Google Scholar Metrics 2008-2012 and 2009-2013 SUBCATEGORIES 2008-2012 2009-2013 Lipids 3 0 African Studies & History 2 2 Architecture 2 2 Asian Studies & History 2 2 Biochemistry 2 2 Bioethics 2 2 Bioinformatics & Computational Biology 2 2 Biomedical Technology 2 2 Biophysics 2 2 Biotechnology 2 2 Canadian Studies & History 2 2 Ceramic Engineering 2 2 Chinese Studies & History 2 2 Combustion & Propulsion 2 2 Development Economics 2 2 Economic History 2 2 Educational Administration 2 2 Educational Technology 2 2 Environmental & Geological Engineering 2 2 Epistemology & Scientific History 2 2 Feminism & Women's Studies 2 2 Food Science & Technology 2 2 Game Theory and Decision Science 2 2 History 2 2 Human Resources & Organizations 2 2 Library & Information Science 2 2 Materials Engineering 2 2 Medical Informatics 2 2

8

Google Scholar Metrics 2014: a low cost bibliometric tool

Medicinal Chemistry Microscopy Middle Eastern & Islamic Studies Molecular Biology Molecular Modeling Nanotechnology Oil, Petroleum & Natural Gas Paleontology Plasma & Fusion Public Health Sex & Sexuality Sustainable Development Sustainable Energy Technology Law Virology Wood Science & Technology TOTAL

2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 2 89

2 0 2 2 2 2 2 2 2 2 2 2 2 2 2 2 84

2.5. Bibliometric indicators of the publications in the GSM rankings First of all, differences between scientific areas regarding bibliometric indicators become apparent once more. In Table 6 we present the maximum and minimum h5-index and h5-median values according to the subject area as shown in the GSM rankings for English written publications (Appendix 3 presents the same indicators by subcategories). It should be kept in mind that this is just a matter of the sizes and the cognitive and methodological natures of these scientific communities, which lead to very diverse publishing and citation habits. Table 6 Maximum and minimum h5-index and h5-median values according to the subject area in the GSM rankings for English written publications (2009-2013)

SUBJECT AREAS Life Sciences & Earth Sciences Health & Medical Sciences Chemical & Material Sciences Physics & Mathematics Engineering & Computer Science Business, Economics & Management Social Sciences Humanities, Literature & Arts

Maximum Minimum Maximum Minimum H5-Index H5-Index H5-Median H5-Median 355 108 495 146 329 129 495 176 193 102 339 133 191 107 263 140 174 93 253 130 168 63 241 92 81 45 116 59 38 25 72 30

Secondly, the significant differences among h index values for the publications of the nine languages covered in GSM (Tables 7a and 7b) should once again be stressed. English written publications have much better results than publications in other languages. It is no wonder that Chinese publications hold the second place, considering the high scientific output in this language. It is surprising, however, that Portuguese publications seem to do better than Spanish publications, considering that the size of the Spanish-speaking scientific community is larger than the Portuguese community. The explanation

9

EC3 Working Papers 17

may have something to do with Brazil’s Open Access policies, exemplified by pioneer initiatives like Scielo. Table 7a Maximun h5-index and h5-median values in the language rankings Google Scholar Metrics: 2007-2011, 2008-2012 and 2009-2013 editions H5-INDEX H5-MEDIAN LANGUAGE 2007-2011* 2008-2012 2009-2013 2007-2011 2008-2012 2009-2013 English 121 349 355 174 504 495 Chinese 23 54 59 31 85 89 Portuguese 14 38 39 19 50 49 Spanish 11 28 27 16 38 37 German 10 22 27 15 28 37 French 7 18 15 10 19 18 Korean 5 7 Japanese 5 9 9 6 12 12 Italian 3 10 9 5 12 13 Dutch 2 10 6 5 12 8 AVERAGE 20 60 61 29 84 84 *April 2012 edition Table 7b Minimum h5-index and h5-median values in the language rankings Google Scholar Metrics: 2007-2011, 2008-2012 and 2009-2013 editions H5-INDEX H5-MEDIAN LANGUAGE 2007-2011*

English 88 Chinese 19 Portuguese 9 Spanish 8 German 6 French 6 Korean 4 Japanese 4 Italian 2 Dutch 1 AVERAGE 15 *April 2012 edition

2008-2012

105 21 10 10 7 6 4 3 1 19

2009-2013

107 23 11 10 7 7

19

4 3 1

2007-2011

112 26 11 10 8 6 5 4 2 1 19

2008-2012

140 26 11 12 8 7 4 4 1 24

2009-2013

142 27 13 12 13 8

25

5 3 1

It is also important to note the stability of these rankings. This can be considered from different points of view. On the one hand, there is the stability of the bibliometric indicators themselves. The differences between the first edition (2007-2011) and the two subsequent are due to the different publication dates (Tables 7a-b). The first edition was released in April 2012, while the second one was released in July 2013, and the current one in June 2014. Moreover, the reason why the results in the current edition (2009-2013) are so similar to those of the previous edition is probably related to the fact that it has been released one month ahead of last year’s publication date (after eleven months, instead of twelve); however, a higher increase was expected, given the rapid growth Google Scholar shows [9,11]. In Table 8 we can see what the annual growth rates of the indicators have been for each of the broad subject areas, languages, and publication types. In the case of the language rankings, there are two different circumstances: h index

10

Google Scholar Metrics 2014: a low cost bibliometric tool

values for English, Portuguese, Chinese and German publications (especially the last two) are increasing, while those of Spanish, French, Italian and Dutch are decreasing. The French and especially the Dutch cases draw our attention. Conversely, when we focus on the results by broad subject areas, we detect a more uniform behaviour: growth rates are mainly positive yet modest, except in the case of Physics & Mathematics. A similar situation can be found in the three publication types, although the higher growth in the group of conferences should be noted. Table 8 Variation in the maximum h5-index values by subject areas, languages and publication types. Google Scholar Metrics: 2008-2012 and 2009-2013 editions VARIATION % SUBJECT AREAS H5-INDEX H5-MEDIAN Life Sciences & Earth Sciences ▲1.72 ▼-1.79 Health & Medical Sciences ▲5.79 ▼-1.59 Chemical & Material Sciences ▲6.04 ▲16.49 Physics & Mathematics ▼-3.05 ▲0.38 Engineering & Computer Science ▲6.75 ▲5.86 Business, Economics & Management ▲4.35 ▲8.56 Social Sciences ▲2.22 ▲1.47 Humanities, Literature & Arts ▬0.00 ▲10.77

English Chinese Portuguese Spanish German French Japanese Italian Dutch

VARIATION % H5-INDEX H5-MEDIAN ▲1.72 ▼-1.79 ▲9.26 ▲4.71 ▲2.63 ▲4.00 ▼-3.57 ▲13.16 ▲22.73 ▲18.75 ▼-16.67 ▼-16.67 ▬ 0.00 ▲7.69 ▼-10.00 ▲13.33 ▼-40.00 ▲8.33

PUBLICATION TYPES Journals Conferences Repositories

VARIATION % H5-INDEX H5-MEDIAN ▲1.72 ▼-1.79 ▲11.32 ▼-4.02 ▲4.35 ▲8.56

LANGUAGES

On the other hand, the stability of GSM must be analysed from the perspective of the publications that enter or slide off the list, as well as from the perspective of the changes in the positions these publications hold in the rankings (Tables 9 and 10) when we compare the current version to the previous one (2008-2012). Global rate of incoming/outgoing titles can be considered as very low (12.9%), although there are differences among languages. It is very low for English written publications (12.6%), and much higher for Chinese, Spanish, Italian and Japanese publications, where it goes above 25% (Table 9). If we apply this analysis to the publications grouped by subject areas –only for English written publications- the number of incoming/outgoing titles remains quite low (12.6%

11

EC3 Working Papers 17

on average). Only in the areas of Humanities, Literature & Arts and Social Sciences do these values increase to 16% and 18% respectively (Table 10). When we study the changes in publication ranks according to quartiles, we also find great stability: 71% of the publications stay in the same quartile as last year. However, there are differences among languages and subject areas. Thus, more than 50% of all French, Japanase and Italian publications find themselves in a different quartile as they were last year. Higher uniformity can be found in subject areas, where only in the areas of Humanities, Literature & Arts, and Social Sciences are these changes more abundant. Table 9 Changes in the list of publications visualized, and in their positions, in the Google Scholar Metrics language rankings (2009-2013) CHANGES IN PUBLICATION RANKS ADDITIONS/ ACCORDING TO QUARTILES* LANGUAGES DELETIONS MOVES UP MOVES DOWN UNCHANGED % % % % English 12.6 14.0 14.6 71.4 Chinese 25.0 18.7 20.0 61.3 Portuguese 15.0 23.2 20.7 56.1 German 19.0 19.8 19.8 60.5 Spanish 26.0 21.6 18.9 59.5 French 24.0 36.8 21.1 42.1 Italian 30.0 35.7 14.3 50.0 Japanese 30.0 21.7 30.4 47.8 Dutch 20.5 16.7 15.2 68.2 AVERAGE 12.9 14.3 14.7 71.0 * Common Publications in the two versions Table 10 Changes in the list of publications visualized, and in their positions, in the Google Scholar Metrics subject rankings (2009-2013) CHANGES IN PUBLICATION RANKS ADDITIONS/ ACCORDING TO QUARTILES* SUBJECT AREAS DELETIONS (ENGLISH) MOVES UP MOVES DOWN UNCHANGED % % % % Business, Economics & Management 10,6 11,2 14,7 74,1 Chemical & Material Sciences 13,2 12,7 14,2 73,0 Engineering & Computer Science 13,8 15,4 15,4 69,2 Health & Medical Sciences 10,9 12,4 13,6 74,0 Humanities, Literature & Arts 16,5 18,4 21,4 60,1 Life Sciences & Earth Sciences 12,3 15,2 13,6 71,2 Physics & Mathematics 10,2 10,2 11,9 77,9 Social Sciences 18,3 14,1 17,9 68,0 AVERAGE 12,6 14,0 14,6 71,4 * Common Publications in the two versions

Lastly, another test that can show us the degree of variability of the GSM rankings is the analysis of correlation between the ranks of the publications that are present in the two versions studied (2008-2012 and 2009-2013). If we calculate Pearson’s correlation to the 4642 publications that are present in these two versions, the correlation is almost absolute: R=.99. A correlation

12

Google Scholar Metrics 2014: a low cost bibliometric tool

analysis by languages and subcategories confirms the above. There is high correlation in almost the totality of cases. The lowest results can be found in the rankings of French, Japanese and Italian publications, and in the subcategories present in Humanities, Literature & Arts, and Social Sciences. Appendix 4 and 5 show the correlation results for each of the languages and subcategories present in GSM.

3. CONCLUSIONS We have established that Google has opted for giving stability to its product instead of adding any more features or improvements, or even correcting some of its greatest shortfalls, which have been outlined in previous works (duplicate titles, errors in the links between documents and the source where they have been published, search deficiencies…). We should welcome the continuity of this initiative, which brings some fresh air to the scientific information market, and creates opportunities for the study of other kinds of impacts created by scientific output. The stability of the indicators is a serious matter, since it reinforces the credibility of the data managed by Google Scholar in the construction of the GSM publication rankings. Despite all technical and methodological errors Google Scholar Metrics presents as a source for scientific evaluation, and despite the fact that we don’t entirely know how everything works behind scenes, we can say that, from a stability point of view, these rankings can be considered as trustworthy and reliable. This does not, however, prevent us from considering that there is clearly a lot of room for improvement for GSM as an information service. In analogy to the world of airlines, we cannot but consider GSM as a “low cost” bibliometric tool. To be completely fair, we should say “no cost”, since users don’t have to pay anything to access it (beyond the cost of the Internet connection), as opposed to what happens with real low cost airlines. From this point of view, it could be argued we shouldn’t demand more of Google. Offering a tool that has required a great deal of effort for solving numerous technical problems (storing and processing great quantities of data, identifying different versions of the same document and merging them, calculating indicators, enabling fast and agile search and visualization features…) free of charge is definitely to be appreciated. However, we cannot overlook these technical and methodological shortcomings if we are to compare this product to other canonical bibliometric journal rankings. Since it is based on the most comprehensive and less skewed scientific database in existance at the moment (Google Scholar), GSM is a valuable tool for learning the impact of thousands of publications that are not covered in any other bibliometric indexes. However, we cannot lose sight of its Achilles’s heel, something we have been reporting insistently: it is vulnerable to tampering, and it is not transparent enough that the scientific community will be able to detect this kind of manipulation [10]. Publishers, in the pursuit of boosting their journals’s impact, may not only manipulate editorial policies (which already

13

EC3 Working Papers 17

happens more frequently than is generally thought), but they could also begin to directly control the impact of their journals by suggesting that authors cite studies published in the same journal. They may also, whether by themselves or in coordination with other parties, upload documents to the Web with citations to studies in their journal. For this reason, it is of the utmost importance that there should be two versions of the h index, one including self-citations, and one that does not take them into account. It is also necessary to find a way to clearly display the sources that provide citations.

ACKNOWLEDGMENTS This study has been funded through the project HAR2011-30383-C02-02 granted by the Dirección General de Investigación y Gestión del Plan Nacional de I+D+I, Ministerio de Economía y Competitividad, Spanish Government.

REFERENCES 1. Delgado López-Cózar, E; Cabezas-Clavijo, Á (2012). Google Scholar Metrics updated: Now it begins to get serious. EC3 Working Papers 8: 16 de noviembr de 2012. Available:http://digibug.ugr.es/bitstream/10481/22439/6/Google%20Scholar%20Metrics %20updated.pdf 2. Delgado-López-Cózar, E., y Cabezas-Clavijo, Á. (2012). Google Scholar Metrics: an unreliable tool for assessing scientific journals.El Profesional de la Información, 21(4), 419–427. Available:http://dx.doi.org/10.3145/epi.2012.jul.15 3. Cabezas-Clavijo, Á., y Delgado-López-Cózar, E. (2012). Scholar Metrics: el impacto de las revistas según Google, ¿un divertimento o un producto científico aceptable? EC3 Working Papers, (1). Available: http://eprints.rclis.org/16830/1/Google%20Scholar%20Metrics.pdf 4. Cabezas-Clavijo, Álvaro; Delgado López-Cózar, Emilio (2013). Google Scholar Metrics 2013: nothing new under the sun. EC3 Working Papers, 12: 25 de julio de 2013. Available: http://arxiv.org/ftp/arxiv/papers/1307/1307.6941.pdf 5. Delgado López-Cózar, E.; Cabezas Clavijo, A. (2013). Ranking journals: could Google Scholar Metrics be an alternative to Journal Citation Reports and Scimago Journal Rank? Learned Publishing, 26 (2): 101-113. Available:http://arxiv.org/ftp/arxiv/papers/1303/1303.5870.pdf 6. Delgado López-Cózar, E.; Ayllón, JM, Ruiz-Pérez, R. (2013). Índice H de las revistas científicas españolas según Google Scholar Metrics (2007-2011). 2ª edición. EC3 Informes, 3: 9 de abril de 2013. Available: http://digibug.ugr.es/handle/10481/24141 7. Ayllón Millán, J.M.; Ruiz-Pérez, R.; Delgado López-Cózar, E. Índice H de las revistas científicas españolas según Google Scholar Metrics (2008-2012). EC3 Reports, 7 (2013). Available: http://hdl.handle.net/10481/29348 8. Delgado López-Cózar, E.; Robinson-Garcia, N. Repositories in Google Scholar Metrics or what is this document type doing in a place as such?. Cybermetrics, 2012, 16(1), paper 4. Available:http://libro.ugr.es/bitstream/10481/22019/1/repositorios_cybermetrics.pdf 9. Orduña-Malea, E.; Delgado López-Cózar, E. (2014). Google Scholar Metrics evolution: an analysis according to languages. Scientometrics, 98 (3): 2353-2367. Available: http://arxiv.org/abs/1310.6162 10. Delgado López‐Cózar, E., Robinson‐García, N., Torres‐Salinas, D. (2014). The Google Scholar Experiment: how to index false papers and manipulate bibliometric indicators. Journal of the Association for Information Science and Technology, 65(3), 446-454. Available: http://arxiv.org/ftp/arxiv/papers/1309/1309.2413.pdf 11. Winter, J.C., Zadpoor, A. A., Dodou, D. (2014). The expansion of Google Scholar versus Web of Science: a longitudinal study. Scientometrics, 98(2), 1547-1565.

14

Google Scholar Metrics 2014: a low cost bibliometric tool

APPENDIX 1 Ranking of visualized conferences in Google Scholar Metrics (2009-2013) CONFERENCES

IEEE Conference on Computer Vision and Pattern Recognition, CVPR International World Wide Web Conferences (WWW) IEEE International Conference on Computer Vision, ICCV Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM) ACM SIGKDD International Conference on Knowledge discovery and data mining International Conference on Machine Learning (ICML) ACM SIGCOMM Conference EGU General Assembly Conference Abstracts ACM Symposium on Information, Computer and Communications Security International Conference on Very Large Databases Meeting of the Association for Computational Linguistics (ACL) ACM SIGMOD Conference IEEE International Conference on Robotics and Automation European Conference on Computer Vision IEEE International Solid-State Circuits Conference International Conference on Software Engineering Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series Symposium on Networked Systems: Design and Implementation (NSDI) ACM International Conference on Web Search and Data Mining International Symposium on Computer Architecture (ISCA) IEEE Symposium on Security and Privacy Conference on Empirical Methods in Natural Language Processing (EMNLP) IEEE Power and Energy Society General Meeting International Conference on Data Engineering Workshops International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) ACM Symposium on Theory of Computing USENIX Security Symposium ECS Meeting Abstracts OFC/NFOEC Conference on Optical Fiber communication/National Fiber Optic Engineers Conference IEEE International Symposium on Information Theory ACM SIGIR Conference on Research and development in information retrieval IEEE/IAS Industrial and Commercial Power Systems Technical Conference International Conference on Weblogs and Social Media Annual International Conference on Theory and Applications of Cryptographic Techniques (EUROCRYPT) ACM International Conference on Information and Knowledge Management Internet Measurement Conference IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) IEEE Transactions on Circuits and Systems I: Regular Papers Society for Economic Dynamics Meeting Papers Annual International Conference on Mobile computing and networking SIGPLAN Conference on Programming Language Design and Implementation (PLDI) IEEE International Symposium on Parallel & Distributed Processing International Joint Conference on Artificial Intelligence (IJCAI) Conference on Advances in cryptology IEEE GLOBECOM Workshops IEEE/RSJ International Conference on Intelligent Robots and Systems

H5-INDEX H5-MEDIAN 118 83 79

167 131 138

76

110

69 69 67 66 65 64 62 61 61 59 59 57 56 54 54 53 53 53 53 52

113 103 131 100 110 92 84 90 87 96 79 94 70 84 82 98 85 78 77 68

51

87

51 51 51

77 76 75

50

67

49 49 49 48

80 71 67 87

48

79

48 47

62 78

47

65

47 46 46

64 80 72

46

71

46 46 45 45 45

67 63 77 63 62

15

EC3 Working Papers 17

ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages (POPL) IEEE International Electron Devices Meeting, IEDM IEEE Symposium on Foundations of Computer Science (FOCS) IEEE International Conference on Communications ACM International Conference on Multimedia IEEE Conference on Decision and Control ACM SIAM Symposium on Discrete Algorithms ACM European Conference on Computer Systems IEEE International Conference on Cloud Computing (CLOUD) IEEE International Symposium on High Performance Computer Architecture IEEE Vehicular Technology Conference, VTC Design, Automation and Test in Europe Conference and Exhibition (DATE) IEEE/ACM International Symposium on Microarchitecture ACM Symposium on User Interface Software and Technology Design Automation Conference (DAC) IEEE Energy Conversion Congress and Exposition (ECCE) Network and Distributed System Security Symposium (NDSS) National Fiber Optic Engineers Conference International Conference on Spoken Language Processing (INTERSPEECH) American Control Conference IEEE Applied Power Electronics Conference and Exposition International Conference on Computer Aided Verification (CAV) European Semantic Web Symposium / Conference Quantum Electronics and Laser Science Conference Conference on File and Storage Technologies (FAST) Conference on Computer Supported Cooperative Work (CSCW) IEEE International Conference on Cloud Computing Technology and Science (CloudCom) British Machine Vision Conference (BMVC) AAAI Conference on Artificial Intelligence Conference on Lasers and Electro-Optics ACM Conference on Recommender Systems International Conference on Distributed Computing Systems, ICDCS IEEE International Conference on Data Mining (ICDM) International Conference on Extending Database Technology (EDBT) ACM SIGPLAN Symposium on Principles & Practice of Parallel Programming (PPOPP) USENIX Annual Technical Conference SIAM International Conference on Data Mining IEEE International Conference on Image Processing (ICIP) International Conference on The Theory and Application of Cryptology and Information Security (ASIACRYPT) IEEE International Symposium on Cluster Computing and the Grid Conference on Object-Oriented Programming Systems, Languages, and Applications (OOPSLA) IEEE International Conference on Computer Vision Workshops (ICCV Workshops) Allerton Conference on Communication, Control, and Computing Workshop on Cryptographic Hardware and Embedded Systems (CHES) International Quantum Electronics Conference ACM Conference on Electronic Commerce IEEE Congress on Evolutionary Computation International Conference on Computational Linguistics (COLING) International Symposium on Software Testing and Analysis International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS)

45

61

45 45 44 44 43 43 42 42 42 42 41 40 40 40 40 39 39 39 39 38 38 38 37 37 37

60 58 62 60 63 59 81 62 62 59 57 62 62 54 53 79 65 52 48 61 53 48 70 62 60

37

58

37 37 36 36 36 36 36

56 50 63 62 49 47 47

35

69

35 35 35

54 49 47

34

58

34

50

34

50

33

59

33 33 32 32 32 31 31

49 45 57 47 39 48 47

31

44

16

Google Scholar Metrics 2014: a low cost bibliometric tool

International Symposium/Conference on Music Information Retrieval International Conference on Document Analysis and Recognition Conference on Genetic and Evolutionary Computation International Conference on Practice and Theory in Public Key Cryptography IEEE Real-Time Systems Symposium (RTSS) Conference of the European Chapter of the Association for Computational Linguistics (EACL) IEEE/ACM International Conference on Automated Software Engineering (ASE) IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW) Computer Security Applications Conference Symposium On Usable Privacy and Security ACM/IEEE International Conference on Human Robot Interaction ACM Symposium on Parallelism in Algorithms and Architectures (SPAA) IEEE/ACM International Conference on Computer-Aided Design (ICCAD) Symposium on Theoretical Aspects of Computer Science (STACS) IFAC World Congress International Conference on Pattern Recognition European Conference on Research in Computer Security European Conference on Object-oriented Programming (ECOOP) International Conference on Functional Programming (ICFP) International Conference on Financial Cryptography and Data Security Asia and South Pacific Design Automation Conference (ASP-DAC) IEEE Information Theory Workshop IEEE Computer Security Foundations Symposium European Conference on Machine learning and knowledge discovery in databases ACM International Conference on Interactive Tabletops and Surfaces (ITS) IEEE Conference of Industrial Electronics International Conference on Biometrics IEEE International Symposium on Circuits and Systems IEEE/MTT-S International Microwave Symposium Symposium on Interactive 3D Graphics (SI3D) International Conference on Intelligent User Interfaces (IUI) Conference on Information Sciences and Systems Symposium on Field Programmable Gate Arrays (FPGA) IEEE Vehicle Power and Propulsion Conference ACM SIGGRAPH/Eurographics Symposium on Computer Animation IEEE Symposium on Logic in Computer Science Electronic Components and Technology Conference, ECTC IEEE PES Power Systems Conference and Exposition Asian Conference on Computer Vision European Conference on Algorithms Symposium on Computational Geometry IEEE Conference on Computational Intelligence and Games European Quantum Electronics Conference IEEE International Reliability Physics Symposium (IRPS) Information Theory and Applications Workshop Workshop of Cross-Language Evaluation Forum ACM/IEEE International Symposium on Low Power Electronics and Design International Conference on Affective Computing and Intelligent Interaction and Workshops ACM/IEEE International Symposium on Networks-on-Chip IEEE Intelligent Vehicles Symposium International Conference on Tangible, embedded, and embodied interaction European Conference on Power Electronics and Applications IFIP Conference on Human-Computer Interaction (INTERACT)

31 31 31 30 30

43 41 39 53 53

30

45

30

44

30

38

29 29 29 29 29 29 29 29 28 28 28 28 28 28 27

50 47 45 44 39 38 35 35 49 45 42 40 36 36 40

27

40

27 27 27 27 27 26 26 26 26 26 26 26 26 25 25 25 25 25 24 24 24 24 24

39 39 34 33 32 38 38 38 37 37 36 36 35 38 36 35 35 34 50 41 39 39 38

24

36

24 24 24 24 24

35 33 31 31 28

17

EC3 Working Papers 17

IEEE Custom Integrated Circuits Conference, CICC IEEE Radio Frequency Integrated Circuits Symposium IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS) IEEE-RAS International Conference on Humanoid Robots (Humanoids) Pacific Symposium on Biocomputing IEEE International Conference on Multimedia and Expo Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining International Conference on Research in Computational Molecular Biology ACM Multimedia Systems Conference (MMSys) International ACM/IEEE Joint Conference on Digital Libraries IEEE Radar Conference IEEE International Conference on RFID IEEE International Conference on Fuzzy Systems (FUZZ) International Workshop on Semantic Evaluation Eurographics - Short Papers IEEE Symposium on VLSI Circuits Picture Coding Symposium (PCS) Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL) IEEE International Geoscience and Remote Sensing Symposium Workshop on Statistical Machine Translation IEEE Pacific Visualization Symposium IEEE Workshop on Automatic Speech Recognition & Understanding European Conference on Antennas and Propagation IEEE Conference on Emerging Technologies & Factory Automation (ETFA) Conference on Image and Video Retrieval International Workshop on Quality of Multimedia Experience IUFRO Workshop on Connection Between Forest Resources and Wood Quality: Modeling Approaches and Simulation Software European Conference on Evolutionary Computation, Machine Learning and Data Mining in Bioinformatics IEEE Aerospace Conference AMIA Symposium International Electron Devices Meeting International Conference on Indoor Positioning and Indoor Navigation (IPIN) IEEE Workshop on Signal Processing Advances in Wireless Communications International Symposium on Software Reliability Engineering IEEE Workshop on Applications of Signal Processing to Audio and Acoustics International Workshop on Internet and Network Economics IEEE International Conference on Industrial Informatics International Offshore and Polar Engineering Conference World Congress on Nature & Biologically Inspired Computing, NaBIC International Conference on Machine Learning and Cybernetics International Conference on Ocean, Offshore and Arctic Engineering IEEE/AIAA Digital Avionics Systems Conference (DASC) Annual Conference on Computer Graphics (SIGGRAPH) ACM/IEEE International Conference on Distributed Smart Cameras International Conference on Computational Linguistics and Intelligent Text Processing International Conference on Parallel problem solving from nature Linguistic Annotation Workshop IEEE Symposium on Computational Intelligence and Data Mining Data Compression Conference, DCC IEEE International Test Conference International Joint Conference on Natural Language Processing ENTER eTourism Conference

23 23

33 33

23

33

23 23 23 22 22 22 21 21 21 21 20 20 20 20

33 30 28 34 32 31 33 31 27 26 49 38 29 29

20

28

20 20 20 20 20 20 19 19

28 27 27 27 26 24 33 31

19

29

19

26

19 19 19 19 18 18 18 17 17 17 17 17 17 16 16 16

25 25 24 24 27 25 23 30 24 23 22 22 20 26 26 23

16

22

16 16 15 15 15 15 15

21 20 30 26 22 21 20

18

Google Scholar Metrics 2014: a low cost bibliometric tool

Workshop on Positioning, Navigation and Communication IEEE International Conference on Semantic Computing European Conference on Genetic Programming IEEE Spoken Language Technology Workshop (SLT) International Conference on Natural Computation Web3D / VRML Symposium IEEE/ION Position, Location and Navigation Symposium European Conference on Synthetic Aperture Radar International Conference on Fuzzy Systems and Knowledge Discovery ACM Symposium on Virtual Reality Software and Technology ACM International Health Informatics Symposium International Conference on Computer Safety, Reliability, and Security IEEE International Conference on Ultra-Wideband IEEE International Conference on Plasma Science (ICOPS) International ITG Workshop on Smart Antennas (WSA) European Radar Conference IEEE Electric Ship Technologies Symposium International Symposium on Turbo Codes and Iterative Information Processing GI-Jahrestagung Multikonferenz Wirtschaftsinformatik (MKWI) International Radar Symposium International Conference on Quantum Information Biennial Symposium on Communications (QBSC) International Conference on Computer Graphics, Imaging and Visualization, CGIV IEEE International Symposium on Phased Array Systems and Technology IEEE/NPSS Symposium on Fusion Engineering SOFE Australian Communications Theory Workshop (AusCTW) Canadian Workshop on Information Theory International Symposium on Information Theory and Its Applications Asian-Pacific Conference on Synthetic Aperture Radar International Conference on Ground Penetrating Radar ESA Workshop on Satellite Navigation Technologies and European Workshop on GNSS Signals and Signal Processing (NAVITEC) Conférence en Recherche d'Infomations et Applications (CORIA) IEEE CIE International Conference on Radar

15 15 15 15 15 14 14 14 14 14 14 14 14 13 13 13 12 12 11 10 10 9 9

20 18 18 17 17 20 19 19 18 17 17 17 17 31 21 16 20 17 14 15 12 21 17

9

14

9 9 8 8 8 8 7

12 11 10 10 10 9 11

7

9

7 6

9 7

19

EC3 Working Papers 17

APPENDIX 2 Ranking of repositories visualized in Google Scholar Metrics (2009-2013) REPOSITORIES NBER Working Papers arXiv Cosmology and Extragalactic Astrophysics (astro-ph.CO) arXiv High Energy Physics - Phenomenology (hep-ph) arXiv Mesoscale and Nanoscale Physics (cond-mat.mes-hall) arXiv Materials Science (cond-mat.mtrl-sci) arXiv Quantum Physics (quant-ph) arXiv High Energy Physics - Theory (hep-th) arXiv High Energy Physics - Experiment (hep-ex) arXiv Superconductivity (cond-mat.supr-con) arXiv High Energy Astrophysical Phenomena (astro-ph.HE) CEPR Discussion Papers arXiv Galaxy Astrophysics (astro-ph.GA) arXiv Solar and Stellar Astrophysics (astro-ph.SR) arXiv Earth and Planetary Astrophysics (astro-ph.EP) arXiv Information Theory (cs.IT) arXiv Quantum Gases (cond-mat.quant-gas) arXiv Strongly Correlated Electrons (cond-mat.str-el) arXiv Optics (physics.optics) IZA Discussion Papers arXiv Nuclear Theory (nucl-th) arXiv Physics and Society (physics.soc-ph) arXiv General Relativity and Quantum Cosmology (gr-qc) arXiv Instrumentation and Methods for Astrophysics (astro-ph.IM) arXiv High Energy Physics - Lattice (hep-lat) arXiv Statistical Mechanics (cond-mat.stat-mech) arXiv Nuclear Experiment (nucl-ex) Policy Research Working Paper Series MPRA Paper arXiv Statistics Theory (math.ST) arXiv Optimization and Control (math.OC) arXiv Soft Condensed Matter (cond-mat.soft) arXiv Atomic Physics (physics.atom-ph) European Central Bank Working Paper Series CESifo Working Paper Series arXiv Other Condensed Matter (cond-mat.other) arXiv Learning (cs.LG) arXiv Probability (math.PR) arXiv Instrumentation and Detectors (physics.ins-det) CEP Discussion Papers arXiv Mathematical Physics (math-ph) Bank for International Settlements Working Papers arXiv Networking and Internet Architecture (cs.NI) arXiv Analysis of PDEs (math.AP) arXiv Disordered Systems and Neural Networks (cond-mat.dis-nn) arXiv Data Structures and Algorithms (cs.DS) arXiv Methodology (stat.ME) arXiv Fluid Dynamics (physics.flu-dyn) arXiv Databases (cs.DB) Bank of Italy Working Papers arXiv Machine Learning (stat.ML) eSocialSciences Working Papers arXiv Plasma Physics (physics.plasm-ph)

H5-INDEX 168 162 145 138 136 128 124 118 109 107 105 101 101 95 92 91 90 90 81 78 76 76 71 69 69 68 62 62 61 61 59 58 57 57 52 50 50 49 48 47 46 46 45 44 44 43 43 42 41 40 40 40

H5-MEDIAN 241 222 194 198 227 204 174 178 162 140 148 138 127 128 137 139 129 125 118 101 109 98 115 94 94 100 87 82 102 99 81 90 98 87 77 78 61 84 85 65 97 72 54 66 56 65 54 57 63 68 61 57

20

Google Scholar Metrics 2014: a low cost bibliometric tool

arXiv Populations and Evolution (q-bio.PE) arXiv Biological Physics (physics.bio-ph) arXiv Distributed, Parallel, and Cluster Computing (cs.DC) arXiv Numerical Analysis (math.NA) World Bank Policy Research Working Paper Series arXiv Computer Vision and Pattern Recognition (cs.CV) arXiv Algebraic Geometry (math.AG) Department of Economics and Business, Universitat Pompeu Fabra Economics Working Papers arXiv Combinatorics (math.CO) HAL Working Papers arXiv Social and Information Networks (cs.SI) arXiv Applications (stat.AP) arXiv Digital Libraries (cs.DL) arXiv Number Theory (math.NT) Harvard Business School Working Papers Harvard University, John F. Kennedy School of Government Working Paper Series arXiv Functional Analysis (math.FA) arXiv Chaotic Dynamics (nlin.CD) arXiv Computer Science and Game Theory (cs.GT) arXiv Differential Geometry (math.DG) Federal Reserve Bank of San Francisco Working Paper Series OECD Economics Department Working Papers arXiv Quantitative Methods (q-bio.QM) Deep Sea Research Part I: Oceanographic Research Papers arXiv Computational Complexity (cs.CC) arXiv Cryptography and Security (cs.CR) CReAM Discussion Paper Series arXiv Pattern Formation and Solitons (nlin.PS) IFPRI discussion papers arXiv Representation Theory (math.RT) arXiv Exactly Solvable and Integrable Systems (nlin.SI) arXiv Genomics (q-bio.GN) arXiv Logic in Computer Science (cs.LO) arXiv Molecular Networks (q-bio.MN) arXiv Classical Analysis and ODEs (math.CA) arXiv Dynamical Systems (math.DS) Hong Kong Institute for Monetary Research Working Papers Resources For the Future Discussion Papers arXiv Computation and Language (cs.CL) arXiv Biomolecules (q-bio.BM) arXiv Programming Languages (cs.PL) World Institute for Development Economic Research (UNU-WIDER) Working Paper Series arXiv Discrete Mathematics (cs.DM) arXiv Group Theory (math.GR) arXiv Geometric Topology (math.GT) arXiv Quantum Algebra (math.QA) arXiv Operator Algebras (math.OA) Human Development Research Papers arXiv Complex Variables (math.CV) arXiv Symplectic Geometry (math.SG) arXiv Rings and Algebras (math.RA) arXiv Commutative Algebra (math.AC) arXiv Atomic and Molecular Clusters (physics.atm-clus) arXiv Algebraic Topology (math.AT)

40 40 39 39 38 38 38

56 50 71 49 63 50 48

37

72

37 36 36 36 35 34 33

46 69 60 52 65 48 61

33

59

33 33 33 33 32 32 32 32 32 31 31 31 30 30 29 29 29 29 29 29 28 28 27 27 27

52 46 44 43 73 56 49 44 39 50 50 41 50 37 45 44 43 41 39 35 42 40 57 44 41

26

38

26 25 24 24 24 23 23 23 23 22 21 21

30 31 34 32 30 41 32 28 27 26 33 30

21

EC3 Working Papers 17

arXiv Metric Geometry (math.MG) arXiv Computational Geometry (cs.CG) CSAE Working Paper Series ADBI Working Papers arXiv Neural and Evolutionary Computing (cs.NE) Asian Development Bank Economics Working Paper Series Brooks World Poverty Institute Working Paper Series Instituto de Pesquisa Econômica Aplicada-IPEA Discussion Papers Asian Economic Papers arXiv History and Philosophy of Physics (physics.hist-ph) East Asian Bureau of Economic Research Trade Working Papers Escola de Economia de São Paulo, Getulio Vargas Foundation (Brazil) Textos para discussão arXiv Graphics (cs.GR)

20 20 19 18 18 17 16 14 13 13 12

30 28 28 31 28 27 35 22 26 18 25

12

20

9

17

22

Google Scholar Metrics 2014: a low cost bibliometric tool

APPENDIX 3 Maximum and minimum h5-index and h5-median values by subject area and subcategory, as they appear in the Google Scholar Metrics publication rankings (2009-2013) AREAS AND SUBCATEGORIES Chemical & Material Sciences Analytical Chemistry Chemical & Material Sciences (general) Materials Engineering Nanotechnology Organic Chemistry Biochemistry Electrochemistry Dispersion Chemistry Polymers & Plastics Inorganic Chemistry Medicinal Chemistry Chemical Kinetics & Catalysis Crystallography & Structural Chemistry Molecular Modeling Corrosion Composite Materials Combustion & Propulsion Ceramic Engineering Oil, Petroleum & Natural Gas Engineering & Computer Science Materials Engineering Nanotechnology Biotechnology Biomedical Technology Computer Vision & Pattern Recognition Sustainable Energy Bioinformatics & Computational Biology Engineering & Computer Science (general) Information Theory Artificial Intelligence Automation & Control Theory Computer Networks & Wireless Communication Signal Processing Databases & Information Systems Food Science & Technology Water Supply & Treatment Educational Technology Operations Research Human Computer Interaction Power Engineering Remote Sensing

MAXIMUM MINIMUM H5-INDEX H5-INDEX

MAXIMUM H5-MEDIAN

MINIMUM H5-MEDIAN

193 102 193 174 174 171 164 100 92 87 78 78 74 70 68 67 59 58 46 36 174 174 174 129 118 118 108 104 98 93 89 86

102 45 42 72 32 37 63 10 18 31 12 25 20 16 13 3 11 11 7 10 93 72 32 36 30 25 29 19 49 8 36 26

339 132 339 253 247 247 281 130 112 161 114 97 97 85 97 89 75 97 58 44 253 253 247 197 143 182 161 205 162 152 122 124

133 57 55 95 41 49 79 13 24 40 15 30 28 20 20 4 15 15 9 13 130 95 41 49 40 34 41 24 66 10 46 35

86 84 83 83 82 81 81 78 78 75

42 31 32 35 16 18 27 24 22 12

143 127 131 112 105 116 109 123 104 98

58 41 47 41 19 28 38 28 31 15

23

EC3 Working Papers 17

Computer Hardware Design Data Mining & Analysis Computer Graphics Molecular Modeling Computer Security & Cryptography Computational Linguistics Robotics Combustion & Propulsion Evolutionary Computation Fuzzy Systems Software Systems Library & Information Science Microelectronics & Electronic Packaging Computing Systems Environmental & Geological Engineering Structural Engineering Metallurgy Manufacturing & Machinery Medical Informatics Theoretical Computer Science Civil Engineering Mechanical Engineering Game Theory and Decision Science Plasma & Fusion Transportation Ceramic Engineering Multimedia Quality & Reliability Wood Science & Technology Mining & Mineral Resources Oil, Petroleum & Natural Gas Textile Engineering Radar, Positioning & Navigation Aviation & Aerospace Engineering Ocean & Marine Engineering Technology Law Architecture Health & Medical Sciences Health & Medical Sciences (general) Molecular Biology Oncology Genetics & Genomics Cardiology Hematology Neurology Gastroenterology & Hepatology Immunology Biomedical Technology Pediatric Medicine Pulmonology Communicable Diseases Diabetes

70 69 68 68 65 62 61 58 57 57 57 56 55 54 54 54 53 51 51 51 49 49 48 48 48 46 46 44 40 36 36 36 35 33 30 20 17 329 329 223 205 188 178 156 135 132 129 118 117 114 113 113

23 13 9 13 27 15 23 11 14 12 27 17 19 34 19 20 13 17 14 24 20 22 16 9 24 7 16 12 6 8 10 4 6 12 11 7 3 129 70 60 66 46 50 34 65 47 48 30 37 31 49 25

94 113 95 97 110 84 88 97 92 92 94 80 73 98 72 78 66 72 78 77 62 60 63 65 64 58 62 60 52 47 44 48 52 46 38 31 25 495 495 343 306 270 274 200 220 181 226 143 162 150 148 163

33 19 14 20 40 17 29 15 17 14 38 21 23 49 22 25 15 23 17 33 25 28 24 11 30 9 22 14 8 10 13 6 7 19 15 8 4 176 102 78 92 59 62 43 84 62 67 40 44 41 62 32

24

Google Scholar Metrics 2014: a low cost bibliometric tool

Pharmacology & Pharmacy Rheumatology Endocrinology Nutrition Science Psychiatry Vascular Medicine Virology Gynecology & Obstetrics Urology & Nephrology Critical Care Psychology Radiology & Medical Imaging Surgery Toxicology Physiology AIDS & HIV Anesthesiology Nuclear Medicine, Radiotherapy & Molecular Imaging Medicinal Chemistry Ophthalmology & Optometry Orthopedic Medicine & Surgery Physical Education & Sports Medicine Reproductive Health Social Psychology Clinical Laboratory Science Epidemiology Transplantation Pathology Pain & Pain Management Gerontology & Geriatric Medicine Dermatology Obesity Public Health Child & Adolescent Psychology Dentistry Heart & Thoracic Surgery Addiction Developmental Disabilities Natural Medicines & Medicinal Plants Plastic & Reconstructive Surgery Tropical Medicine & Parasitology Emergency Medicine Primary Health Care Neurosurgery Veterinary Medicine Medical Informatics Nursing Rehabilitation Therapy Otolaryngology Hospice & Palliative Care Oral & Maxillofacial Surgery

110 107 106 103 103 103 98 97 96 95 92 92 90 89 83 82 82

55 26 46 34 50 33 32 33 36 13 52 39 36 39 34 15 22

186 148 139 136 143 136 125 175 144 140 142 122 124 118 179 122 115

68 32 60 46 67 44 39 40 46 17 67 53 48 48 46 19 28

80 78 78 75 75 75 75 74 74 74 73 72 71 70 69 69 64 63 62 61 59 59 59 59 58 58 57 54 51 49 48 47 46 44

26 25 34 38 36 29 21 10 29 13 29 13 36 28 6 31 30 31 10 21 16 20 12 25 18 11 13 24 14 24 20 23 7 13

107 97 110 100 95 103 114 109 97 100 119 106 99 95 95 98 95 81 79 84 78 87 72 74 85 84 74 73 78 67 60 66 62 62

32 30 39 49 46 36 31 11 38 18 36 19 48 35 7 39 40 40 13 26 25 23 13 27 21 16 16 29 17 29 32 27 9 16

25

EC3 Working Papers 17

Pregnancy & Childbirth Alternative & Traditional Medicine Audiology, Speech & Language Pathology Bioethics Life Sciences & Earth Sciences Life Sciences & Earth Sciences (general) Molecular Biology Cell Biology Biochemistry Biotechnology Developmental Biology & Embryology Environmental Sciences Sustainable Energy Microbiology Bioinformatics & Computational Biology Virology Botany Atmospheric Sciences Evolutionary Biology Food Science & Technology Ecology Sustainable Development Proteomics, Peptides & Aminoacids Biophysics Hydrology & Water Resources Soil Sciences Biodiversity & Conservation Biology Geology Geochemistry & Mineralogy Animal Husbandry Agronomy & Crop Science Environmental & Geological Engineering Forests & Forestry Oceanography Marine Sciences & Fisheries Zoology Insects & Arthropods Animal Behavior & Ethology Plant Pathology Wood Science & Technology Paleontology Pest Control & Pesticides Mycology Birds Physics & Mathematics Physics & Mathematics (general) Astronomy & Astrophysics High Energy & Nuclear Physics Condensed Matter Physics & Semiconductors Quantum Mechanics Optics & Photonics

39 37 35 29 355 355 223 223 164 129 121 115 108 105 104 98 93 89 86 83 83 75 74 65 62 61 60 59 58 56 55 54 53 49 49 48 48 47 46 40 39 37 37 25 191 191 162 145

21 16 11 8 108 57 60 72 63 36 29 44 29 47 19 32 42 34 18 35 37 25 20 25 15 21 28 30 16 19 30 19 15 30 33 18 20 11 13 6 12 10 11 7 107 43 33 39

58 54 51 40 495 495 343 343 281 197 192 151 161 161 205 125 132 120 142 112 124 105 101 81 83 82 89 74 71 70 75 72 72 84 71 64 81 65 75 52 50 46 49 36 263 263 222 194

31 21 17 11 146 78 78 95 79 49 35 55 41 60 24 39 51 46 21 41 53 34 27 30 20 27 35 40 23 23 40 22 17 34 42 23 27 13 16 8 16 12 16 10 140 54 44 47

138 128 122

38 7 35

227 204 186

48 9 53

26

Google Scholar Metrics 2014: a low cost bibliometric tool

Geophysics Spectroscopy & Molecular Physics Biophysics Mathematical Analysis Pure & Applied Mathematics Mathematical Optimization Nonlinear Science Probability & Statistics with Applications Computational Mathematics Electromagnetism Thermal Sciences Mathematical Physics Fluid Mechanics Acoustics & Sound Plasma & Fusion Algebra Geometry Discrete Mathematics Business, Economics & Management Economics Finance Economic Policy Human Resources & Organizations Entrepreneurship & Innovation Business, Economics & Management (general) Strategic Management Marketing Tourism & Hospitality Development Economics International Business Accounting & Taxation Game Theory and Decision Science Emergency Management Educational Administration Economic History Social Sciences Cognitive Science Environmental & Occupational Medicine Environmental Law & Policy Educational Technology Human Resources & Organizations Health Policy & Medical Law Sustainable Development Ethics Public Health Social Sciences (general) Development Economics Library & Information Science Political Science Education Educational Psychology & Counseling

91 73 65 64 64 61 61 61 60 58 58 52 51 49 48 43 43 37 168 168 116 105 81 73

27 26 25 22 16 18 21 34 25 20 17 15 14 16 9 20 20 18 63 50 31 32 37 19

127 101 81 95 95 99 78 113 78 75 76 78 77 75 65 62 62 48 241 241 179 148 118 101

36 33 30 30 19 24 26 39 34 25 20 20 16 23 11 26 27 22 92 80 41 53 54 27

72 72 65 63 62 60 57 48 39 32 22 81 92 89 87 81 81 77 75 70 69 66 62 56 54 52 52

33 42 26 13 16 15 20 16 4 11 3 45 32 28 16 18 37 9 25 10 31 31 16 17 25 32 17

122 113 111 91 111 84 87 63 56 48 33 116 138 118 115 116 118 111 105 98 98 96 111 80 85 86 74

52 61 36 18 20 24 28 24 7 14 3 59 42 34 20 28 54 11 34 11 39 38 20 21 33 46 22

27

EC3 Working Papers 17

Science & Engineering Education Diplomacy & International Relations Geography & Cartography Sociology Teaching & Teacher Education Sex & Sexuality Urban Studies & Planning Family Studies Public Policy & Administration Academic & Psychological Testing Anthropology Forensic Science Higher Education Law Paleontology Social Work Archaeology Criminology, Criminal Law & Policing Special Education Educational Administration Epistemology & Scientific History Human Migration Early Childhood Education Bioethics Chinese Studies & History Military Studies Feminism & Women's Studies African Studies & History Asian Studies & History International Law Economic History History European Law Technology Law Architecture Canadian Studies & History Middle Eastern & Islamic Studies Humanities, Literature & Arts Sex & Sexuality Communication Language & Linguistics Gender Studies Foreign Language Learning Epistemology & Scientific History Ethnic & Cultural Studies Philosophy Humanities, Literature & Arts (general) Music & Musicology Chinese Studies & History Religion Feminism & Women's Studies African Studies & History

52 48 47 47 47 46 46 44 42 40 40 40 40 39 39 39 38 36 33 32 32 32 30 29 29 27 25 24 24 23 22 22 21 20 17 17 15 38 46 45 36 35 34 32 32 32 31 31 29 26 25 24

20 16 18 30 18 11 24 13 15 10 12 10 15 27 12 21 10 19 16 11 9 9 12 8 6 9 6 8 12 14 3 8 5 7 3 3 5 25 11 20 16 10 13 9 10 15 14 9 6 8 6 8

70 75 70 82 61 60 79 64 57 54 51 58 54 71 50 60 45 49 48 48 43 55 59 40 44 45 36 38 36 40 33 33 31 31 25 26 24 72 60 72 51 41 50 43 55 44 44 43 44 30 36 38

28 22 24 38 22 13 34 15 22 13 15 15 21 37 16 27 14 25 23 14 12 13 19 11 9 11 9 12 16 19 3 12 5 8 4 5 6 30 13 31 23 12 18 12 14 20 18 12 9 11 9 12

28

Google Scholar Metrics 2014: a low cost bibliometric tool

Asian Studies & History English Language & Literature History Canadian Studies & History Latin American Studies Middle Eastern & Islamic Studies Visual Arts Drama & Theater Arts Literature & Writing Film American Literature & Studies French Studies

24 23 22 17 17 15 13 12 11 10 8 8

12 5 8 3 4 5 4 4 6 4 3 1

36 35 33 26 27 24 18 17 24 19 15 12

16 6 12 5 5 6 5 4 7 5 4 2

29

EC3 Working Papers 17

APENDIX 4 Correlation between the positions of the publications by languages in the last two editions of GSM (2008-2012 and 2009-2013) SUBCATEGORIES CORRELATION Dutch German Portuguese Spanish Chinese Italian French Japanese

0.91 0.88 0.77 0.77 0.77 0.68 0.64 0.62

30

Google Scholar Metrics 2014: a low cost bibliometric tool

APPENDIX 5 Correlation between the positions of the publications by subcategories in the last two editions of GSM (2008-2012 and 2009-2013)

SUBCATEGORIES Business, Economics & Management Emergency Management Economic History Marketing Human Resources & Organizations Entrepreneurship & Innovation International Business Economics Finance Development Economics Game Theory and Decision Science Educational Administration Accounting & Taxation Tourism & Hospitality Strategic Management Economic Policy Business, Economics & Management (general) Chemical & Material Sciences Corrosion Electrochemistry Inorganic Chemistry Composite Materials Dispersion Chemistry Materials Engineering Analytical Chemistry Nanotechnology Chemical Kinetics & Catalysis Medicinal Chemistry Polymers & Plastics Ceramic Engineering Oil, Petroleum & Natural Gas Crystallography & Structural Chemistry Combustion & Propulsion Biochemistry Organic Chemistry Chemical & Material Sciences (general) Molecular Modeling

CORRELATION

ADDITIONS / DELETIONS %

0,98 0,97 0,96 0,95 0,95 0,95 0,94 0,94 0,94 0,93 0,93 0,92 0,92 0,89 0,86

20 25 10 10 5 5 5 0 5 15 15 10 10 5 10

0,80

20

0,99 0,98 0,98 0,98 0,97 0,96 0,96 0,96 0,95 0,95 0,95 0,95 0,93 0,92 0,92 0,91 0,88 0,87 0,85

15 10 25 5 5 5 5 5 10 5 15 15 5 10 0 25 35 50 5

31

EC3 Working Papers 17

Engineering & Computer Science Metallurgy Mining & Mineral Resources Plasma & Fusion Data Mining & Analysis Fuzzy Systems Remote Sensing Technology Law Sustainable Energy Structural Engineering Ocean & Marine Engineering Materials Engineering Water Supply & Treatment Computer Graphics Robotics Nanotechnology Wood Science & Technology Bioinformatics & Computational Biology Power Engineering Medical Informatics Information Theory Ceramic Engineering Computer Hardware Design Computer Vision & Pattern Recognition Software Systems Library & Information Science Engineering & Computer Science (general) Oil, Petroleum & Natural Gas Game Theory and Decision Science Textile Engineering Biotechnology Combustion & Propulsion Radar, Positioning & Navigation Transportation Computer Security & Cryptography Computing Systems Automation & Control Theory Manufacturing & Machinery Computer Networks & Wireless Communication Signal Processing Operations Research Civil Engineering Evolutionary Computation Biomedical Technology Theoretical Computer Science

0,99 0,98 0,98 0,97 0,97 0,97 0,97 0,97 0,96 0,96 0,96 0,96 0,96 0,96 0,96 0,95 0,95 0,95 0,95 0,95 0,95 0,95 0,95 0,94 0,94 0,94 0,93 0,93 0,93 0,93 0,92 0,92 0,92 0,91 0,91 0,91 0,91

10 30 0 20 30 10 25 15 5 10 5 10 10 10 5 5 20 20 20 10 15 5 15 20 15 15 5 15 20 15 0 10 15 25 35 0 5

0,91 0,90 0,90 0,90 0,89 0,89 0,89

10 0 0 5 20 35 15

32

Google Scholar Metrics 2014: a low cost bibliometric tool

Databases & Information Systems Mechanical Engineering Human Computer Interaction Artificial Intelligence Quality & Reliability Molecular Modeling Educational Technology Aviation & Aerospace Engineering Microelectronics & Electronic Packaging Food Science & Technology Environmental & Geological Engineering Multimedia Computational Linguistics Architecture Health & Medical Sciences Pain & Pain Management Vascular Medicine Obesity Anesthesiology Oncology Pathology Surgery Transplantation AIDS & HIV Molecular Biology Critical Care Pulmonology Hospice & Palliative Care Addiction Clinical Laboratory Science Primary Health Care Bioethics Physiology Health & Medical Sciences (general) Communicable Diseases Diabetes Epidemiology Genetics & Genomics Audiology, Speech & Language Pathology Immunology Psychiatry Cardiology Nutrition Science Medicinal Chemistry Gastroenterology & Hepatology Neurosurgery

0,89 0,88 0,88 0,87 0,86 0,85 0,85 0,84 0,83 0,81 0,81 0,80 0,80 0,77

20 10 30 15 15 5 20 10 10 10 10 20 15 25

0,99 0,99 0,98 0,98 0,98 0,98 0,98 0,98 0,98 0,98 0,98 0,98 0,97 0,97 0,97 0,97 0,97 0,97 0,97 0,96 0,96 0,96 0,96 0,96 0,96 0,96 0,96 0,96 0,95 0,95 0,95

10 5 5 5 10 20 10 0 0 15 10 10 5 10 10 5 5 10 25 5 5 5 15 10 5 10 20 15 5 5 5

33

EC3 Working Papers 17

Toxicology Rheumatology Emergency Medicine Pediatric Medicine Medical Informatics Oral & Maxillofacial Surgery Urology & Nephrology Neurology Ophthalmology & Optometry Pregnancy & Childbirth Rehabilitation Therapy Plastic & Reconstructive Surgery Natural Medicines & Medicinal Plants Social Psychology Hematology Physical Education & Sports Medicine Dermatology Reproductive Health Veterinary Medicine Heart & Thoracic Surgery Tropical Medicine & Parasitology Gynecology & Obstetrics Psychology Public Health Nuclear Medicine, Radiotherapy & Molecular Imaging Orthopedic Medicine & Surgery Biomedical Technology Developmental Disabilities Alternative & Traditional Medicine Virology Endocrinology Dentistry Child & Adolescent Psychology Radiology & Medical Imaging Otolaryngology Pharmacology & Pharmacy Nursing Gerontology & Geriatric Medicine Humanities, Literature & Arts Gender Studies Sex & Sexuality Foreign Language Learning Chinese Studies & History Epistemology & Scientific History Music & Musicology

0,95 0,95 0,95 0,95 0,95 0,95 0,95 0,94 0,94 0,94 0,94 0,94 0,94 0,93 0,93 0,93 0,93 0,93 0,91 0,91 0,91 0,91 0,91 0,91

20 5 15 10 20 10 15 0 5 10 15 5 20 15 10 5 15 5 35 0 10 5 15 15

0,90 0,90 0,89 0,89 0,89 0,88 0,88 0,87 0,87 0,86 0,86 0,86 0,86 0,82

15 15 35 5 10 25 20 10 10 0 5 25 20 5

0,97 0,96 0,96 0,95 0,95 0,94

10 20 5 10 25 5

34

Google Scholar Metrics 2014: a low cost bibliometric tool

Middle Eastern & Islamic Studies Canadian Studies & History Drama & Theater Arts History Latin American Studies Language & Linguistics Visual Arts Ethnic & Cultural Studies English Language & Literature African Studies & History French Studies Feminism & Women's Studies Religion Philosophy Asian Studies & History American Literature & Studies Communication Humanities, Literature & Arts (general) Film Literature & Writing Life Sciences & Earth Sciences Biodiversity & Conservation Biology Molecular Biology Environmental Sciences Birds Hydrology & Water Resources Pest Control & Pesticides Sustainable Energy Mycology Animal Behavior & Ethology Life Sciences & Earth Sciences (general) Plant Pathology Wood Science & Technology Evolutionary Biology Paleontology Bioinformatics & Computational Biology Developmental Biology & Embryology Proteomics, Peptides & Aminoacids Biophysics Cell Biology Geology Soil Sciences Botany Sustainable Development Forests & Forestry Biotechnology

0,93 0,92 0,92 0,91 0,91 0,90 0,89 0,88 0,84 0,83 0,81 0,81 0,78 0,76 0,74 0,73 0,69 0,66 0,54 0,32

10 45 25 25 15 10 35 5 10 10 20 10 15 10 10 25 10 20 25 20

0,98 0,98 0,98 0,97 0,97 0,97 0,97 0,96 0,96 0,96 0,96 0,95 0,95 0,95 0,95 0,95 0,95 0,94 0,94 0,94 0,94 0,94 0,94 0,94 0,93

20 15 10 10 0 10 15 15 20 35 15 5 15 5 20 5 5 15 10 15 5 10 10 5 15

35

EC3 Working Papers 17

Animal Husbandry Geochemistry & Mineralogy Atmospheric Sciences Virology Ecology Marine Sciences & Fisheries Biochemistry Zoology Insects & Arthropods Microbiology Food Science & Technology Environmental & Geological Engineering Oceanography Agronomy & Crop Science Physics & Mathematics Mathematical Physics Fluid Mechanics Plasma & Fusion Mathematical Optimization Quantum Mechanics Astronomy & Astrophysics Probability & Statistics with Applications Mathematical Analysis Computational Mathematics Algebra High Energy & Nuclear Physics Acoustics & Sound Thermal Sciences Discrete Mathematics Nonlinear Science Biophysics Condensed Matter Physics & Semiconductors Optics & Photonics Physics & Mathematics (general) Spectroscopy & Molecular Physics Geometry Pure & Applied Mathematics Geophysics Electromagnetism Social Sciences Health Policy & Medical Law Economic History Geography & Cartography Academic & Psychological Testing Technology Law

0,93 0,93 0,93 0,93 0,92 0,91 0,91 0,90 0,89 0,88 0,81 0,81 0,79 0,73

10 15 15 10 10 10 25 15 10 5 10 10 10 20

0,99 0,98 0,98 0,98 0,98 0,97 0,97 0,97 0,97 0,96 0,95 0,95 0,95 0,95 0,95 0,94

5 20 0 10 0 5 15 5 0 10 10 15 5 5 15 15

0,94 0,94 0,93 0,92 0,91 0,90 0,83 0,70

10 10 15 15 10 15 25 10

0,98 0,97 0,97 0,97 0,97

20 25 15 15 25

36

Google Scholar Metrics 2014: a low cost bibliometric tool

Diplomacy & International Relations Sex & Sexuality Education Forensic Science European Law Ethics Human Resources & Organizations Chinese Studies & History Epistemology & Scientific History Paleontology International Law Political Science Early Childhood Education Urban Studies & Planning Educational Psychology & Counseling Library & Information Science Environmental Law & Policy Sustainable Development Development Economics Anthropology Educational Administration Middle Eastern & Islamic Studies Human Migration Family Studies Canadian Studies & History Archaeology Military Studies History Cognitive Science Higher Education Teaching & Teacher Education Public Health Science & Engineering Education Environmental & Occupational Medicine Criminology, Criminal Law & Policing Public Policy & Administration Special Education Educational Technology Law African Studies & History Feminism & Women's Studies Social Work Architecture Asian Studies & History Social Sciences (general)

0,97 0,96 0,96 0,96 0,96 0,96 0,95 0,95 0,95 0,95 0,95 0,95 0,95 0,94 0,94 0,94 0,94 0,94 0,94 0,93 0,93 0,93 0,93 0,93 0,92 0,92 0,91 0,91 0,91 0,91 0,91 0,91 0,90 0,90 0,88 0,87 0,87 0,85 0,84 0,83 0,81 0,78 0,77 0,74 0,56

25 20 10 10 30 15 10 10 25 5 15 5 10 10 0 15 10 10 5 25 15 10 0 15 45 15 5 25 10 10 15 15 5 15 15 10 25 20 5 10 10 20 25 10 35

37