Skip to Main Content

Research Metrics Toolkit

"I'm applying for a promotion, and need to demonstrate the engagement and outstanding impact of my work within my discipline and the wider community. How do I find and identify the best research metrics to include in my application?"

Metrics for Science Researchers

For Science researchers, many research metrics are available quickly and easily through your author profiles in three key places:

Scopus and Web of Science each index a list of specific journals. Both databases cover Science topics well, so you will likely find most of your journal article publications in your profile. However, coverage might not be as strong as some Health and Science topics. There is more limited coverage of books, book chapters, and conference papers - but you may find that some of these publications are included too. Google Scholar can be helpful as its search engine usually finds more publications and citations from across the web.

How to: Search strategies

Source types (article, book, book chapter, etc.)

For information about research outputs relevant to your researcher profile, see Section 7: Research of your Academic Unit Work Plan Policy and the following research outputs per academic unit:

  • School of Science:
    • Publication outputs in Q1 and Q2 journals (SCImago) over the last three years
    • An author's M-index (Scopus h-index divided by years since graduation with a PhD (taking into account career interruptions)); and
    • 'Media' (alternate publications including The Conversation, public reports, media interviews, etc.).
  • Hawkesbury Institute for the Environment (HIE):
    • Prepare and submit high-quality research papers for publication
    • Attain measures of academic esteem such as:
      • awards, recognised awards, prestigious international awards, or recognition by peers
      • co-authorship on a scientific paper, or
      • memberships of committees (national or international committees), academies, or expert panels or editorial panels of journals.
  • MARCS Institute (MARCS): Given the diverse nature of the research carried out at MARCS, where possible, a suite of
    quality metrics and indicators will be made available to researchers from different fields.
    • Prepare and submit high-quality research papers for publication
    • Attain measures of academic esteem such as:
      • awards, recognised awards, prestigious international awards, or recognition by peers
      • co-authorship on a scientific paper or
      • memberships of committees (national or international committees), academies, expert panels, or editorial panels of journals.
  • School of Computer, Data and Mathematical Sciences: The allocation of a research profile and a research workload should be agreed upon by the staff member and their supervisor using suitable discipline-specific reference data:
    • Typically, the most recent ERA data for the relevant (sub-) field should be used as a benchmark for evaluating a staff member’s research output against the definitions of the research profiles in Clauses 7.1 to 7.3. of the School's Work Plan Policy
    • Non-conventional research outputs will be considered in this context using the ERA eligibility requirements
    • Service to the community or the academic discipline (including refereeing or the organisation of conferences) or to professional
      engagement (including leadership roles in professional bodies such as board membership).
    • Refereeing (for instance, membership of editorial boards, requests for refereeing, and the like).
  • School of Engineering, Design and Built Environment:
    • Weighted Publication Outputs (last six years) (at least 50% of journal publications are required to be Q1 journals for claiming above 30% research workload)
    • Eligible outputs include research books, book chapters, journal articles, refereed conference publications, creative works, and commissioned reports, averaged across three years. HERDC weightings (one significant book equivalent to five journal articles) should be considered. The quality and quantity of the outputs should be considered, with improvement in research output quality being an important target. The ranges above provide the opportunity to balance these considerations.

Different databases specialise in providing metrics data about different publications (e.g. journal articles, books, book chapters, etc.).

The databases where you will likely find references to your work (with advice about how to search them) are listed below. To search a database, use the Field in your Field of Research (FoR) code or from your research question to search the Title field in a database or to search by subject.

Start your search strategy by using the following resources.

  • Endeavour to publish in quality publishing houses and quality journals. If you don't find a suitable journal in these Lists, search the databases below, starting with Scopus Sources database.
Record-keeping

Give careful thought to record-keeping, ideally before you start.

  • It is advisable to use a spreadsheet or Word document.
  • Here is a suggested spreadsheet template [Excel download] for collecting citations.
Note: When searching across databases, it can be challenging to identify duplicates.

Even if you have not used EndNote before, compiling an EndNote library of references that have cited your work can be an excellent resource. Using EndNote, you can:

  • export detailed citation data from many databases with a few clicks
  • easily identify duplicate references
  • see at a glance who is citing your work and in what context

Contact the Library if you think EndNote could assist you or if you are unsure where to start.

Explore citing references

Remember:

  • there are more ways to impact your discipline than to be cited in academic works. The context surrounding citing references can provide important evidence of impact.

For example:

  • has your work been cited by esteemed authors (e.g., professors of international standing, textbook authors) or in journals with a high impact factor?
  • has your work, or an article that cited your work, been referred to in a judicial or administrative decision?
  • is your work cited in non-academic documents relied on by industry or the community, e.g. Australian standards, in legislation?
  • have you been cited by policy reports or textbooks?
Counting

As a researcher, you may have to explain your research impact to audiences or reviewers who are not from the same discipline as you.

Carefully consider how you can frame your research to impress a non-academic reader. For exemplar statements, take a look at the SciVal, InCitesAltmetric Explorer, and Google Scholar metrics.

For example: "X publication has 10 citations in Google Scholar, six of these being in journals with SCImago journal quartiles of Q1 or Q2."

"What are the key metrics and indicators for traditional research outputs?"

About discipline-based quality metrics/indicators:

  • HDR candidates: Consult with your supervisors to determine if any discipline-specific quality metrics or indicators are applicable to your intellectual contributions.
  • Researchers: Refer to the University Work Plan Policy, which includes the 2024 School Work Plan Policies, and review your individual work plans for guidance on your work plan profile research outputs/intellectual contributions and relevant outcomes.

Citation-based metrics are widely used to measure and demonstrate the impact of traditional research outputs such as journal articles, books, book chapters and conference proceedings. Reviews and esteem indicators of conference organisers or book publishers/editors may help establish the prestige and quality of conferences or books. On the other hand, author metrics (e.g., h-index) are often used to evidence the overall impact of research.

Bibliometrics (citation metrics) are quantitative indicators of a publication's reach. They use various statistical methods to analyse publications, author output, and citation counts. Indicators can be gathered from multiple sources.

  • The Finding metrics section lists the sources you can use to find your publications, co-authors and who is citing your work.
  • This Guide will help you find bibliometrics for grant applications and performance.

Here are examples of metrics to include in your application and how to find them.

  Journal articles

Article-level metrics are usually available from the article's record page in different databases. However, to get some information, such as journal metrics, you may be required to go to other resources (e.g., SCImago). Similar to author metrics, the numbers might differ across databases due to their coverage.

Metrics Source Where to find the information
Citation count (without self-cites) (#) (SciVal), Times Cited (without self-Cites) (#) (InCites), Cited by (#) (Google Scholar) Scopus, Web of Science, Google Scholar Journal article citation counts
[Article] Field-Weighted Citation Impact (FWCI) (#) Scopus [Article] FWCI
Article ranking (citation percentiles) (# or %) Scopus, Web of Science

Article citation percentiles/Article ranking/Outputs in Top Citation Percentiles

% Top Papers (%), % Highly Cited Papers (%) Web of Science Article citation percentiles/Article ranking/Outputs in Top Citation Percentiles
Altmetrics (e.g. social media and news mentions) Altmetric Explorer, PlumX Altmetrics

Journal impact indicators (#)

(use caution: journal metrics are for journals, not articles)

Scopus, Web of Science Journal impact indicators

Journal ranking and quartile in category (#)

(use caution: journal metrics are for journals, not articles)

Scopus, Web of Science

Journal ranking lists

  Books and chapters

Metrics and indicators for books and chapters can be challenging to find. This is due to the limitation in indexing books in the major citation databases (such as Scopus and Web of Science) compared to journals. Google Scholar is another key tool for gathering citation metrics and reviews of books and chapters.

Metrics or indicators Source Where to find the information
Citation count (without self-cites) (#) (SciVal), Times Cited (#) (without self-Cites) (InCites), Cited by (#) (Google Scholar) Scopus, Web of Science, Google Scholar

Book and book chapter metrics

[Article] Field Weighted Citation Impact (FWCI) (#) Scopus Book/chapter record in Scopus
Altmetrics (e.g., social media and news mentions) Altmetric Explorer, Scopus (PlumX) Altmetric bookmarklet, Article record in Scopus
Worldwide and Australian library holdings of books WorldCat, Trove Book holdings in WorldCat and Trove
Book and/or chapter reviews Google Scholar, Library Search (Advance) Book review via Library Search
Credentials of the publisher and/or editors Google, Publisher website Search Google or the publisher's website

Awards received

Listing on university/school or professional body reading list, bestseller list

Google, Publish website

 

Search Google or the publisher's website
  Conference papers

Similar to books and chapters, article-level metrics for conference papers can be difficult to find. The prestige and credentials of the conference and its organiser can often indicate the quality and status of a conference in its related research fields.

It's critical to be strategic when choosing which conference to attend and present your papers at. For more information, see the Conference: The how-to-choose guide.

Metrics or indicators Source Where to find the information
Citation Count (without self-cites) (#) (SciVal), Times Cited (without self-Cites) (#) (InCites), Cited by (#)(Google Scholar) Scopus, Web of Science, Google Scholar Conference paper record in the relevant database
Prestige of the conference in a field Google, conference website Search Google or the conference website
Credentials of the conference organiser Google, conference website Search Google or the conference website
  Author impact indicators

Author-level metrics are available from your profiles in Elements, Scopus, Web of Science, or Google Scholar and take into account all your publications that are indexed (available) in the related database. The numbers might be different in different databases due to their coverage.

Metrics Source Where to find the information
Citation Count (without self-cites) (#) (SciVal), Times Cited (without self-cites) (#) (InCites), Cited by (Google Scholar) (#) Scopus, Web of Science, Google Scholar Researcher Profiles (SciVal), 

Article citation percentiles/Article ranking/Outputs in Top Citation Percentiles

Scholarly Output (#) (Scopus), Web of Science Documents (#) (WoS) Scopus, Web of Science, Google Scholar Researcher Profiles
h-index (with and without self-cites) (#) Scopus, Web of Science Researcher Profiles, SciVal, InCites
i10-index (#) Google Scholar Google Scholar profile
h5-index (#) Scopus SciVal Overview tab
m-index (#) Scopus SciVal Overview tab
g-index (#) Scopus SciVal Overview tab
Benchmark: [Author] Field Weighted Citation Impact (FWCI) (#) (SciVal), [Author] Category Normalized Citation Impact (CNCI) (#) (InCites)

Scopus, Web of Science

[Author] FWCI and [Author] CNCI
Contributed to Topic Clusters (#) Scopus SciVal
  Other Impact indicators

You can use our subscribed benchmarking tools (SciVal and InCites) to indicate your work's engagement and outstanding impact within your discipline and the wider community. The benchmarking is available against your peers and overall institution, country or global performance.

Metrics Source Where to find the information
Citations per Document (#), Citation Impact (#) Scopus, Web of Science SciVal, InCites
Number of citing countries (#) Scopus SciVal
Attention by Region (#) Altmetric Explorer Altmetric Explorer
Benchmark: Cited Publications (%) Scopus SciVal
Benchmark: Outputs in Top Citation Percentiles (1% and 10%) (# or %) (SciVal), % Documents in Top 1% and 10% (%) (InCites) Scopus, Web of Science SciVal, InCites
Benchmark: Publications in top journal quartiles and prominent percentile by a specific journal ranking (%) Scopus, Web of Science SciVal, InCites
% Highly Cited Papers (%) Web of Science InCites
% Hot Papers (%) Web of Science InCites
Benchmark: Collaboration (%) (see national, international, and industry collaboration indicators) Scopus, Web of Science SciVal, InCites
Patent-citations count (#) (SciVal), Patent-Citations per Scholarly Output (#) (SciVal), Scholarly Output CIted by Patents (#) (SciVal), Patnt Count (#) (SciVal), Citation from Patents (#) (InCites), Patent Mentions (#) (Altmetric Explorer) Scopus, Web of Science, Altmetric Explorer SciVal, InCites, Altmetric Explorer
Policy mentions (#) Altmetric Explorer Altmetric Explorer
  Altmetrics

Altmetrics, or Alternative Metrics, refers to data that indicate the impact or attention a particular work receives on social media such as views, downloads, mentions in the media, and shares via platforms such as Twitter, blogs, Facebook and Mendeley. Altmetric providers also track citations in publications such as policy documents, patents, and medical guidelines.

Metrics Source Where to find the information
Social media - Tweets, Facebook likes, blog posts etc. PlumX, Altmetric Explorer PlumX Metrics via Scopus, Altmetric Explorer, Publisher websites
Article stats - views, downloads, saves etc. PlumX, Altmetric Explorer,  Research Profiles and Repository PlumX Metrics via Scopus, Altmetric Explorer, Research Profiles and Repository, Publisher websites
News mentions PlumX, Altmetric Explorer PlumX Metrics via Scopus, Altmetric Explorer, Publisher websites
Policy mentions Altmetric Explorer Altmetric Explorer, Publisher websites
Patent citations Altmetric Explorer Altmetric Explorer, Publisher websites

Interpretation and good practice

The following guides provide advice and practical application tips for some of the most commonly used indicators.

Other Resources

Tip: Policy citations, patent citations, and news citations can demonstrate impact

Want to know if your research has been cited in any policy documents, patents, or the news? Altmetric.com captures this data for publications with a DOI, and the quickest way to access it is via the Research Portal:

  1. Log in to the Research Portal
  2. View your publication list by searching for then clicking on your name in red text. You should see a list of publications association with your name.
  3. Scroll down the list to find the Altmetric 'donuts'. Look out for purple stripes (policy) and light red stripes (news) or orange stripes (patents).

“OK - now I have some information about my publications, and my h-index. I am interested in more detail though - like how to benchmark my metrics and my citations with others. How can I do that?”

Find out how to use the SciVal and InCites research analytics products to benchmark your metrics with individuals, groups, institutions, research fields, and more.

© Western Sydney University, unless otherwise attributed.
Library guide created by Western Sydney University Library staff is licenced under a Creative Commons Attribution 4.0 International (CC BY)