Name: Pubpeer comments
Can apply to: Research papers with a DOI (Digital Object Identifier)
Metric definition: Pubpeer is a post-publication peer review platform. The full text of comments submitted by registered and unregistered users are publicly available.
Metric calculation: Pubpeer comments can be generated by registered and unregistered users for any paper with a DOI. Full text comments can be retrieved via common identifiers (e.g. PMID, DOI), keywords, and author names. Comments by registered users are immediately published, while comments by unregistered users are screened for spam content.
Data sources: Comments on articles generated by registered and unregistered Pubpeer users
Appropriate use cases: Pubpeer comments can be used to provide preliminary insight into how a paper is being received and discussed within a research community.
Limitations: While comments can be generated for any paper with a DOI, coverage is limited to and driven by user activity, and not the quality or significance of individual papers. Therefore, differences in quality or significance should not be inferred when comparing papers with and without Pubpeer comments.
Inappropriate use cases: Pubpeer comments are not a replacement for peer review, and should not be used as a measure of research impact.
Available metric sources: Pubpeer and Altmetric.com
Transparency: Pubpeer comments are published for registered and unregistered users. Registered users are always anonymous. Only the user name, not the specific identity or credentials, of registered users is available.
Timeframe: Pubpeer comments have been available since 2012, but comments can be generated for any paper with a DOI.