Item talk:Q56180: Difference between revisions

From geokb
(Added abstract and other texts to publication item's discussion page for reference)
 
(Update item cache)
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
= Final report on the assessment of the U.S. Geological Survey’s bureauwide Research Grade Evaluation (RGE) process =
{
The U.S. Geological Survey (USGS) formed the internal Research Grade Evaluation (RGE) Review Team in May 2017. The Team undertook a 2-year comprehensive review of RGE practices and policies at the USGS that included (1) the first-ever quantitative assessment of the USGS workforce evaluated under the RGE process, (2) a benchmarking meet­ing in March 2018 of the USGS and 11 other Federal science agencies to compare how each conducts research scientist evaluation, and (3) extensive surveys of four internal stakeholder groups. The Team recommends that the RGE review process emphasize the importance of outcomes resulting from a scientist’s efforts, rather than focusing on easily quantified outputs such as peer-reviewed papers, presentations, and posters. Thus, the Team recommends that a scientist’s work be assessed according to contributions and impacts in three areas: (1) scientific understanding, (2) the missions of the U.S. Geological Survey and the U.S. Department of the Interior, and (3) society more broadly. The Team developed (1) new formats for the Research Scientist Record (RSR) and Development Scientist Record (DSR) that match the Office of Personnel Management’s guidelines for factor scoring and (2) new findings templates to pro­vide more meaningful feedback to scientists.
  "USGS Publications Warehouse": {
 
    "schema": {
== Table of Contents ==
      "@context": "https://schema.org",
* Executive Summary
      "@type": "CreativeWork",
* Overview of Why and How We Did Our Work
      "additionalType": "USGS Numbered Series",
* What We Learned
      "name": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
* Key Recommendations for RGE Processes
      "identifier": [
* Other Key Recommendations
        {
* References Cited
          "@type": "PropertyValue",
* Appendix 1A. Charge Given to the Research Grade Evaluation Review Team of the U.S. Geological Survey
          "propertyID": "USGS Publications Warehouse IndexID",
* Appendix 1B. Members of the Research Grade Evaluation Review Team of the U.S. Geological Survey
          "value": "ofr20211035",
* Appendix 2. Detailed Evaluation of Workforce Data
          "url": "https://pubs.usgs.gov/publication/ofr20211035"
* Appendix 3. Graphic Summary of Results of Surveys of Three Groups of Stakeholders About the Research Grade Evaluation Process in the U.S. Geological Survey
        },
* Appendix 4. Benchmarking Information From a Comparison of Methods Used To Evaluate Research Scientists
        {
* Appendix 5A. Research Scientist Record Template
          "@type": "PropertyValue",
* Appendix 5B. Findings Template for Use After Review of a Research Scientist Record
          "propertyID": "USGS Publications Warehouse Internal ID",
* Appendix 5C. Development Scientist Record Template
          "value": 70220120
* Appendix 5D. Findings Template for Use After Review of a Development Scientist Record
        },
* Appendix 5E. Cover Sheet for Research Scientist Record (RSR) or Development Scientist Record (DSR)
        {
* Appendix 5F. Guidelines for Scoring in Excess of Level E
          "@type": "PropertyValue",
* Appendix 5G. Findings Form for Scientist Considered for Promotion to Senior Scientist (ST)
          "propertyID": "DOI",
* Appendix 5H. Standard Reviewer Questions for References
          "value": "10.3133/ofr20211035",
* Appendix 6. Report on Beta Test of the Recommended New Formats for the Research Scientist Record and Findings Templates and Processes Used by Peer Review Panels
          "url": "https://doi.org/10.3133/ofr20211035"
* Appendix 7. Explanations of Terms Used in This Report
        }
* Appendix 8. Additional Criteria for Senior Scientist Positions
      ],
* Appendix 9. Key Recommendations for Updating the Research Grade Evaluation Process for the U.S. Geological Survey
      "inLanguage": "en",
      "isPartOf": [
        {
          "@type": "CreativeWorkSeries",
          "name": "Open-File Report"
        }
      ],
      "datePublished": "2021",
      "dateModified": "2021-04-29",
      "abstract": "The U.S. Geological Survey (USGS) formed the internal Research Grade Evaluation (RGE) Review Team in May 2017. The Team undertook a 2-year comprehensive review of RGE practices and policies at the USGS that included (1) the first-ever quantitative assessment of the USGS workforce evaluated under the RGE process, (2) a benchmarking meet\u00ading in March 2018 of the USGS and 11 other Federal science agencies to compare how each conducts research scientist evaluation, and (3) extensive surveys of four internal stakeholder groups. The Team recommends that the RGE review process emphasize the importance of outcomes resulting from a scientist\u2019s efforts, rather than focusing on easily quantified outputs such as peer-reviewed papers, presentations, and posters. Thus, the Team recommends that a scientist\u2019s work be assessed according to contributions and impacts in three areas: (1) scientific understanding, (2) the missions of the U.S. Geological Survey and the U.S. Department of the Interior, and (3) society more broadly. The Team developed (1) new formats for the Research Scientist Record (RSR) and Development Scientist Record (DSR) that match the Office of Personnel Management\u2019s guidelines for factor scoring and (2) new findings templates to pro\u00advide more meaningful feedback to scientists.",
      "description": "vi, 106 p.",
      "publisher": {
        "@type": "Organization",
        "name": "U.S. Geological Survey"
      },
      "author": [
        {
          "@type": "Organization",
          "name": "U.S. Geological Survey Research Grade Evaluation Review Team"
        }
      ],
      "funder": [
        {
          "@type": "Organization",
          "name": "Office of Science Quality and Integrity",
          "url": "https://www.usgs.gov/office-of-science-quality-and-integrity"
        }
      ]
    }
  },
  "OpenAlex": {
    "abstract_inverted_index": {
      "First": [
        0
      ],
      "posted": [
        1
      ],
      "April": [
        2
      ],
      "29,": [
        3
      ],
      "2021": [
        4
      ],
      "For": [
        5
      ],
      "additional": [
        6
      ],
      "information,": [
        7
      ],
      "contact:": [
        8
      ],
      "Office": [
        9,
        199
      ],
      "of": [
        10,
        49,
        64,
        80,
        101,
        117,
        162,
        171,
        200
      ],
      "Science": [
        11
      ],
      "Quality": [
        12
      ],
      "and": [
        13,
        52,
        83,
        97,
        136,
        151,
        167,
        174,
        191,
        207
      ],
      "IntegrityU.S.": [
        14
      ],
      "Geological": [
        15,
        27,
        165
      ],
      "Survey12201": [
        16
      ],
      "Sunrise": [
        17
      ],
      "Valley": [
        18
      ],
      "DriveMS": [
        19
      ],
      "911Reston,": [
        20
      ],
      "VA": [
        21
      ],
      "20192Contact": [
        22
      ],
      "Pubs": [
        23
      ],
      "Warehouse": [
        24
      ],
      "The": [
        25,
        42,
        106,
        179
      ],
      "U.S.": [
        26,
        164,
        169
      ],
      "Survey": [
        28,
        166
      ],
      "(USGS)": [
        29
      ],
      "formed": [
        30
      ],
      "the": [
        31,
        55,
        60,
        65,
        70,
        81,
        110,
        115,
        139,
        160,
        163,
        168,
        172,
        186,
        198
      ],
      "internal": [
        32,
        103
      ],
      "Research": [
        33,
        187
      ],
      "Grade": [
        34
      ],
      "Evaluation": [
        35
      ],
      "(RGE)": [
        36
      ],
      "Review": [
        37
      ],
      "Team": [
        38,
        43,
        107,
        140,
        180
      ],
      "in": [
        39,
        77,
        153
      ],
      "May": [
        40
      ],
      "2017.": [
        41
      ],
      "undertook": [
        44
      ],
      "a": [
        45,
        74,
        121,
        143
      ],
      "2-year": [
        46
      ],
      "comprehensive": [
        47
      ],
      "review": [
        48,
        112
      ],
      "RGE": [
        50,
        71,
        111
      ],
      "practices": [
        51
      ],
      "policies": [
        53
      ],
      "at": [
        54
      ],
      "USGS": [
        56,
        66,
        82
      ],
      "that": [
        57,
        109,
        142,
        196
      ],
      "included": [
        58
      ],
      "(1)": [
        59,
        156,
        182
      ],
      "first-ever": [
        61
      ],
      "quantitative": [
        62
      ],
      "assessment": [
        63
      ],
      "workforce": [
        67
      ],
      "evaluated": [
        68
      ],
      "under": [
        69
      ],
      "process,": [
        72
      ],
      "(2)": [
        73,
        159,
        208
      ],
      "benchmarking": [
        75
      ],
      "meet\u00ading": [
        76
      ],
      "March": [
        78
      ],
      "2018": [
        79
      ],
      "11": [
        84
      ],
      "other": [
        85
      ],
      "Federal": [
        86
      ],
      "science": [
        87
      ],
      "agencies": [
        88
      ],
      "to": [
        89,
        149,
        212,
        217
      ],
      "compare": [
        90
      ],
      "how": [
        91
      ],
      "each": [
        92
      ],
      "conducts": [
        93
      ],
      "research": [
        94
      ],
      "scientist": [
        95
      ],
      "evaluation,": [
        96
      ],
      "(3)": [
        98,
        175
      ],
      "extensive": [
        99
      ],
      "surveys": [
        100
      ],
      "four": [
        102
      ],
      "stakeholder": [
        104
      ],
      "groups.": [
        105
      ],
      "recommends": [
        108,
        141
      ],
      "process": [
        113
      ],
      "emphasize": [
        114
      ],
      "importance": [
        116
      ],
      "outcomes": [
        118
      ],
      "resulting": [
        119
      ],
      "from": [
        120
      ],
      "scientist\u2019s": [
        122,
        144
      ],
      "efforts,": [
        123
      ],
      "rather": [
        124
      ],
      "than": [
        125
      ],
      "focusing": [
        126
      ],
      "on": [
        127
      ],
      "easily": [
        128
      ],
      "quantified": [
        129
      ],
      "outputs": [
        130
      ],
      "such": [
        131
      ],
      "as": [
        132
      ],
      "peer-reviewed": [
        133
      ],
      "papers,": [
        134
      ],
      "presentations,": [
        135
      ],
      "posters.": [
        137
      ],
      "Thus,": [
        138
      ],
      "work": [
        145
      ],
      "be": [
        146
      ],
      "assessed": [
        147
      ],
      "according": [
        148
      ],
      "contributions": [
        150
      ],
      "impacts": [
        152
      ],
      "three": [
        154
      ],
      "areas:": [
        155
      ],
      "scientific": [
        157
      ],
      "understanding,": [
        158
      ],
      "missions": [
        161
      ],
      "Department": [
        170
      ],
      "Interior,": [
        173
      ],
      "society": [
        176
      ],
      "more": [
        177,
        214
      ],
      "broadly.": [
        178
      ],
      "developed": [
        181
      ],
      "new": [
        183,
        209
      ],
      "formats": [
        184
      ],
      "for": [
        185,
        204
      ],
      "Scientist": [
        188,
        193
      ],
      "Record": [
        189,
        194
      ],
      "(RSR)": [
        190
      ],
      "Development": [
        192
      ],
      "(DSR)": [
        195
      ],
      "match": [
        197
      ],
      "Personnel": [
        201
      ],
      "Management\u2019s": [
        202
      ],
      "guidelines": [
        203
      ],
      "factor": [
        205
      ],
      "scoring": [
        206
      ],
      "findings": [
        210
      ],
      "templates": [
        211
      ],
      "pro\u00advide": [
        213
      ],
      "meaningful": [
        215
      ],
      "feedback": [
        216
      ],
      "scientists.": [
        218
      ]
    },
    "apc_list": null,
    "apc_paid": null,
    "authorships": [],
    "best_oa_location": {
      "is_oa": true,
      "landing_page_url": "https://doi.org/10.3133/ofr20211035",
      "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
      "source": {
        "id": "https://openalex.org/S4210194219",
        "display_name": "Antarctica A Keystone in a Changing World",
        "issn_l": "0196-1497",
        "issn": [
          "0196-1497",
          "2331-1258",
          "2332-4899"
        ],
        "is_oa": true,
        "is_in_doaj": false,
        "is_core": true,
        "host_organization": "https://openalex.org/P4310316088",
        "host_organization_name": "United States Department of the Interior",
        "host_organization_lineage": [
          "https://openalex.org/P4310316088"
        ],
        "host_organization_lineage_names": [
          "United States Department of the Interior"
        ],
        "type": "journal"
      },
      "license": null,
      "license_id": null,
      "version": "publishedVersion",
      "is_accepted": true,
      "is_published": true
    },
    "biblio": {
      "volume": null,
      "issue": null,
      "first_page": null,
      "last_page": null
    },
    "citation_normalized_percentile": null,
    "cited_by_api_url": "https://api.openalex.org/works?filter=cites:W4237331165",
    "cited_by_count": 0,
    "cited_by_percentile_year": {
      "min": 0,
      "max": 60
    },
    "concepts": [
      {
        "id": "https://openalex.org/c2781113848",
        "wikidata": "https://www.wikidata.org/wiki/Q2915366",
        "display_name": "Geological survey",
        "level": 2,
        "score": 0.67110103,
        "qid": null
      },
      {
        "id": "https://openalex.org/c161191863",
        "wikidata": "https://www.wikidata.org/wiki/Q199655",
        "display_name": "Library science",
        "level": 1,
        "score": 0.4559657,
        "qid": "Q226257"
      },
      {
        "id": "https://openalex.org/c86251818",
        "wikidata": "https://www.wikidata.org/wiki/Q816754",
        "display_name": "Benchmarking",
        "level": 2,
        "score": 0.45031193,
        "qid": null
      },
      {
        "id": "https://openalex.org/c98045186",
        "wikidata": "https://www.wikidata.org/wiki/Q205663",
        "display_name": "Process (computing)",
        "level": 2,
        "score": 0.43113342,
        "qid": null
      },
      {
        "id": "https://openalex.org/c2778139618",
        "wikidata": "https://www.wikidata.org/wiki/Q13440398",
        "display_name": "Workforce",
        "level": 2,
        "score": 0.42387113,
        "qid": null
      },
      {
        "id": "https://openalex.org/c17744445",
        "wikidata": "https://www.wikidata.org/wiki/Q36442",
        "display_name": "Political science",
        "level": 0,
        "score": 0.3067996,
        "qid": "Q226183"
      },
      {
        "id": "https://openalex.org/c41008148",
        "wikidata": "https://www.wikidata.org/wiki/Q21198",
        "display_name": "Computer science",
        "level": 0,
        "score": 0.2746944,
        "qid": "Q158969"
      },
      {
        "id": "https://openalex.org/c187736073",
        "wikidata": "https://www.wikidata.org/wiki/Q2920921",
        "display_name": "Management",
        "level": 1,
        "score": 0.2212779,
        "qid": "Q169154"
      },
      {
        "id": "https://openalex.org/c127313418",
        "wikidata": "https://www.wikidata.org/wiki/Q1069",
        "display_name": "Geology",
        "level": 0,
        "score": 0.11740789,
        "qid": "Q158984"
      },
      {
        "id": "https://openalex.org/c151730666",
        "wikidata": "https://www.wikidata.org/wiki/Q7205",
        "display_name": "Paleontology",
        "level": 1,
        "score": 0.0,
        "qid": "Q159017"
      },
      {
        "id": "https://openalex.org/c199539241",
        "wikidata": "https://www.wikidata.org/wiki/Q7748",
        "display_name": "Law",
        "level": 1,
        "score": 0.0,
        "qid": "Q166219"
      },
      {
        "id": "https://openalex.org/c162324750",
        "wikidata": "https://www.wikidata.org/wiki/Q8134",
        "display_name": "Economics",
        "level": 0,
        "score": 0.0,
        "qid": "Q166161"
      },
      {
        "id": "https://openalex.org/c111919701",
        "wikidata": "https://www.wikidata.org/wiki/Q9135",
        "display_name": "Operating system",
        "level": 1,
        "score": 0.0,
        "qid": "Q226285"
      }
    ],
    "corresponding_author_ids": [],
    "corresponding_institution_ids": [],
    "countries_distinct_count": 0,
    "counts_by_year": [],
    "created_date": "2022-05-12",
    "datasets": [],
    "display_name": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
    "doi": "https://doi.org/10.3133/ofr20211035",
    "fulltext_origin": "pdf",
    "fwci": 0.0,
    "grants": [],
    "has_fulltext": true,
    "id": "https://openalex.org/W4237331165",
    "ids": {
      "openalex": "https://openalex.org/W4237331165",
      "doi": "https://doi.org/10.3133/ofr20211035"
    },
    "indexed_in": [
      "crossref"
    ],
    "institutions_distinct_count": 0,
    "is_paratext": false,
    "is_retracted": false,
    "keywords": [
      {
        "id": "https://openalex.org/keywords/geological-survey",
        "display_name": "Geological survey",
        "score": 0.67110103
      },
      {
        "id": "https://openalex.org/keywords/research-data",
        "display_name": "Research Data",
        "score": 0.48242
      },
      {
        "id": "https://openalex.org/keywords/benchmarking",
        "display_name": "Benchmarking",
        "score": 0.45031193
      }
    ],
    "language": "en",
    "locations": [
      {
        "is_oa": true,
        "landing_page_url": "https://doi.org/10.3133/ofr20211035",
        "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
        "source": {
          "id": "https://openalex.org/S4210194219",
          "display_name": "Antarctica A Keystone in a Changing World",
          "issn_l": "0196-1497",
          "issn": [
            "0196-1497",
            "2331-1258",
            "2332-4899"
          ],
          "is_oa": true,
          "is_in_doaj": false,
          "is_core": true,
          "host_organization": "https://openalex.org/P4310316088",
          "host_organization_name": "United States Department of the Interior",
          "host_organization_lineage": [
            "https://openalex.org/P4310316088"
          ],
          "host_organization_lineage_names": [
            "United States Department of the Interior"
          ],
          "type": "journal"
        },
        "license": null,
        "license_id": null,
        "version": "publishedVersion",
        "is_accepted": true,
        "is_published": true
      }
    ],
    "locations_count": 1,
    "mesh": [],
    "ngrams_url": "https://api.openalex.org/works/W4237331165/ngrams",
    "open_access": {
      "is_oa": true,
      "oa_status": "gold",
      "oa_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
      "any_repository_has_fulltext": false
    },
    "primary_location": {
      "is_oa": true,
      "landing_page_url": "https://doi.org/10.3133/ofr20211035",
      "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
      "source": {
        "id": "https://openalex.org/S4210194219",
        "display_name": "Antarctica A Keystone in a Changing World",
        "issn_l": "0196-1497",
        "issn": [
          "0196-1497",
          "2331-1258",
          "2332-4899"
        ],
        "is_oa": true,
        "is_in_doaj": false,
        "is_core": true,
        "host_organization": "https://openalex.org/P4310316088",
        "host_organization_name": "United States Department of the Interior",
        "host_organization_lineage": [
          "https://openalex.org/P4310316088"
        ],
        "host_organization_lineage_names": [
          "United States Department of the Interior"
        ],
        "type": "journal"
      },
      "license": null,
      "license_id": null,
      "version": "publishedVersion",
      "is_accepted": true,
      "is_published": true
    },
    "primary_topic": {
      "id": "https://openalex.org/T11937",
      "display_name": "Data Sharing and Stewardship in Science",
      "score": 0.9668,
      "subfield": {
        "id": "https://openalex.org/subfields/1710",
        "display_name": "Information Systems"
      },
      "field": {
        "id": "https://openalex.org/fields/17",
        "display_name": "Computer Science"
      },
      "domain": {
        "id": "https://openalex.org/domains/3",
        "display_name": "Physical Sciences"
      }
    },
    "publication_date": "2021-01-01",
    "publication_year": 2021,
    "referenced_works": [
      "https://openalex.org/W4241161963"
    ],
    "referenced_works_count": 1,
    "related_works": [
      "https://openalex.org/W4254648744",
      "https://openalex.org/W4254301698",
      "https://openalex.org/W4230658059",
      "https://openalex.org/W2965559317",
      "https://openalex.org/W2554671766",
      "https://openalex.org/W2181044488",
      "https://openalex.org/W2082086861",
      "https://openalex.org/W2068643977",
      "https://openalex.org/W2044563579",
      "https://openalex.org/W2030000021"
    ],
    "sustainable_development_goals": [],
    "title": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
    "topics": [
      {
        "id": "https://openalex.org/T11937",
        "display_name": "Data Sharing and Stewardship in Science",
        "score": 0.9668,
        "subfield": {
          "id": "https://openalex.org/subfields/1710",
          "display_name": "Information Systems"
        },
        "field": {
          "id": "https://openalex.org/fields/17",
          "display_name": "Computer Science"
        },
        "domain": {
          "id": "https://openalex.org/domains/3",
          "display_name": "Physical Sciences"
        }
      }
    ],
    "type": "article",
    "type_crossref": "journal-article",
    "updated_date": "2024-08-09T12:48:35.397167",
    "versions": [],
    "qid": "Q56180"
  }
}

Latest revision as of 22:57, 14 August 2024

{

 "USGS Publications Warehouse": {
   "schema": {
     "@context": "https://schema.org",
     "@type": "CreativeWork",
     "additionalType": "USGS Numbered Series",
     "name": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
     "identifier": [
       {
         "@type": "PropertyValue",
         "propertyID": "USGS Publications Warehouse IndexID",
         "value": "ofr20211035",
         "url": "https://pubs.usgs.gov/publication/ofr20211035"
       },
       {
         "@type": "PropertyValue",
         "propertyID": "USGS Publications Warehouse Internal ID",
         "value": 70220120
       },
       {
         "@type": "PropertyValue",
         "propertyID": "DOI",
         "value": "10.3133/ofr20211035",
         "url": "https://doi.org/10.3133/ofr20211035"
       }
     ],
     "inLanguage": "en",
     "isPartOf": [
       {
         "@type": "CreativeWorkSeries",
         "name": "Open-File Report"
       }
     ],
     "datePublished": "2021",
     "dateModified": "2021-04-29",
     "abstract": "The U.S. Geological Survey (USGS) formed the internal Research Grade Evaluation (RGE) Review Team in May 2017. The Team undertook a 2-year comprehensive review of RGE practices and policies at the USGS that included (1) the first-ever quantitative assessment of the USGS workforce evaluated under the RGE process, (2) a benchmarking meet\u00ading in March 2018 of the USGS and 11 other Federal science agencies to compare how each conducts research scientist evaluation, and (3) extensive surveys of four internal stakeholder groups. The Team recommends that the RGE review process emphasize the importance of outcomes resulting from a scientist\u2019s efforts, rather than focusing on easily quantified outputs such as peer-reviewed papers, presentations, and posters. Thus, the Team recommends that a scientist\u2019s work be assessed according to contributions and impacts in three areas: (1) scientific understanding, (2) the missions of the U.S. Geological Survey and the U.S. Department of the Interior, and (3) society more broadly. The Team developed (1) new formats for the Research Scientist Record (RSR) and Development Scientist Record (DSR) that match the Office of Personnel Management\u2019s guidelines for factor scoring and (2) new findings templates to pro\u00advide more meaningful feedback to scientists.",
     "description": "vi, 106 p.",
     "publisher": {
       "@type": "Organization",
       "name": "U.S. Geological Survey"
     },
     "author": [
       {
         "@type": "Organization",
         "name": "U.S. Geological Survey Research Grade Evaluation Review Team"
       }
     ],
     "funder": [
       {
         "@type": "Organization",
         "name": "Office of Science Quality and Integrity",
         "url": "https://www.usgs.gov/office-of-science-quality-and-integrity"
       }
     ]
   }
 },
 "OpenAlex": {
   "abstract_inverted_index": {
     "First": [
       0
     ],
     "posted": [
       1
     ],
     "April": [
       2
     ],
     "29,": [
       3
     ],
     "2021": [
       4
     ],
     "For": [
       5
     ],
     "additional": [
       6
     ],
     "information,": [
       7
     ],
     "contact:": [
       8
     ],
     "Office": [
       9,
       199
     ],
     "of": [
       10,
       49,
       64,
       80,
       101,
       117,
       162,
       171,
       200
     ],
     "Science": [
       11
     ],
     "Quality": [
       12
     ],
     "and": [
       13,
       52,
       83,
       97,
       136,
       151,
       167,
       174,
       191,
       207
     ],
     "IntegrityU.S.": [
       14
     ],
     "Geological": [
       15,
       27,
       165
     ],
     "Survey12201": [
       16
     ],
     "Sunrise": [
       17
     ],
     "Valley": [
       18
     ],
     "DriveMS": [
       19
     ],
     "911Reston,": [
       20
     ],
     "VA": [
       21
     ],
     "20192Contact": [
       22
     ],
     "Pubs": [
       23
     ],
     "Warehouse": [
       24
     ],
     "The": [
       25,
       42,
       106,
       179
     ],
     "U.S.": [
       26,
       164,
       169
     ],
     "Survey": [
       28,
       166
     ],
     "(USGS)": [
       29
     ],
     "formed": [
       30
     ],
     "the": [
       31,
       55,
       60,
       65,
       70,
       81,
       110,
       115,
       139,
       160,
       163,
       168,
       172,
       186,
       198
     ],
     "internal": [
       32,
       103
     ],
     "Research": [
       33,
       187
     ],
     "Grade": [
       34
     ],
     "Evaluation": [
       35
     ],
     "(RGE)": [
       36
     ],
     "Review": [
       37
     ],
     "Team": [
       38,
       43,
       107,
       140,
       180
     ],
     "in": [
       39,
       77,
       153
     ],
     "May": [
       40
     ],
     "2017.": [
       41
     ],
     "undertook": [
       44
     ],
     "a": [
       45,
       74,
       121,
       143
     ],
     "2-year": [
       46
     ],
     "comprehensive": [
       47
     ],
     "review": [
       48,
       112
     ],
     "RGE": [
       50,
       71,
       111
     ],
     "practices": [
       51
     ],
     "policies": [
       53
     ],
     "at": [
       54
     ],
     "USGS": [
       56,
       66,
       82
     ],
     "that": [
       57,
       109,
       142,
       196
     ],
     "included": [
       58
     ],
     "(1)": [
       59,
       156,
       182
     ],
     "first-ever": [
       61
     ],
     "quantitative": [
       62
     ],
     "assessment": [
       63
     ],
     "workforce": [
       67
     ],
     "evaluated": [
       68
     ],
     "under": [
       69
     ],
     "process,": [
       72
     ],
     "(2)": [
       73,
       159,
       208
     ],
     "benchmarking": [
       75
     ],
     "meet\u00ading": [
       76
     ],
     "March": [
       78
     ],
     "2018": [
       79
     ],
     "11": [
       84
     ],
     "other": [
       85
     ],
     "Federal": [
       86
     ],
     "science": [
       87
     ],
     "agencies": [
       88
     ],
     "to": [
       89,
       149,
       212,
       217
     ],
     "compare": [
       90
     ],
     "how": [
       91
     ],
     "each": [
       92
     ],
     "conducts": [
       93
     ],
     "research": [
       94
     ],
     "scientist": [
       95
     ],
     "evaluation,": [
       96
     ],
     "(3)": [
       98,
       175
     ],
     "extensive": [
       99
     ],
     "surveys": [
       100
     ],
     "four": [
       102
     ],
     "stakeholder": [
       104
     ],
     "groups.": [
       105
     ],
     "recommends": [
       108,
       141
     ],
     "process": [
       113
     ],
     "emphasize": [
       114
     ],
     "importance": [
       116
     ],
     "outcomes": [
       118
     ],
     "resulting": [
       119
     ],
     "from": [
       120
     ],
     "scientist\u2019s": [
       122,
       144
     ],
     "efforts,": [
       123
     ],
     "rather": [
       124
     ],
     "than": [
       125
     ],
     "focusing": [
       126
     ],
     "on": [
       127
     ],
     "easily": [
       128
     ],
     "quantified": [
       129
     ],
     "outputs": [
       130
     ],
     "such": [
       131
     ],
     "as": [
       132
     ],
     "peer-reviewed": [
       133
     ],
     "papers,": [
       134
     ],
     "presentations,": [
       135
     ],
     "posters.": [
       137
     ],
     "Thus,": [
       138
     ],
     "work": [
       145
     ],
     "be": [
       146
     ],
     "assessed": [
       147
     ],
     "according": [
       148
     ],
     "contributions": [
       150
     ],
     "impacts": [
       152
     ],
     "three": [
       154
     ],
     "areas:": [
       155
     ],
     "scientific": [
       157
     ],
     "understanding,": [
       158
     ],
     "missions": [
       161
     ],
     "Department": [
       170
     ],
     "Interior,": [
       173
     ],
     "society": [
       176
     ],
     "more": [
       177,
       214
     ],
     "broadly.": [
       178
     ],
     "developed": [
       181
     ],
     "new": [
       183,
       209
     ],
     "formats": [
       184
     ],
     "for": [
       185,
       204
     ],
     "Scientist": [
       188,
       193
     ],
     "Record": [
       189,
       194
     ],
     "(RSR)": [
       190
     ],
     "Development": [
       192
     ],
     "(DSR)": [
       195
     ],
     "match": [
       197
     ],
     "Personnel": [
       201
     ],
     "Management\u2019s": [
       202
     ],
     "guidelines": [
       203
     ],
     "factor": [
       205
     ],
     "scoring": [
       206
     ],
     "findings": [
       210
     ],
     "templates": [
       211
     ],
     "pro\u00advide": [
       213
     ],
     "meaningful": [
       215
     ],
     "feedback": [
       216
     ],
     "scientists.": [
       218
     ]
   },
   "apc_list": null,
   "apc_paid": null,
   "authorships": [],
   "best_oa_location": {
     "is_oa": true,
     "landing_page_url": "https://doi.org/10.3133/ofr20211035",
     "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
     "source": {
       "id": "https://openalex.org/S4210194219",
       "display_name": "Antarctica A Keystone in a Changing World",
       "issn_l": "0196-1497",
       "issn": [
         "0196-1497",
         "2331-1258",
         "2332-4899"
       ],
       "is_oa": true,
       "is_in_doaj": false,
       "is_core": true,
       "host_organization": "https://openalex.org/P4310316088",
       "host_organization_name": "United States Department of the Interior",
       "host_organization_lineage": [
         "https://openalex.org/P4310316088"
       ],
       "host_organization_lineage_names": [
         "United States Department of the Interior"
       ],
       "type": "journal"
     },
     "license": null,
     "license_id": null,
     "version": "publishedVersion",
     "is_accepted": true,
     "is_published": true
   },
   "biblio": {
     "volume": null,
     "issue": null,
     "first_page": null,
     "last_page": null
   },
   "citation_normalized_percentile": null,
   "cited_by_api_url": "https://api.openalex.org/works?filter=cites:W4237331165",
   "cited_by_count": 0,
   "cited_by_percentile_year": {
     "min": 0,
     "max": 60
   },
   "concepts": [
     {
       "id": "https://openalex.org/c2781113848",
       "wikidata": "https://www.wikidata.org/wiki/Q2915366",
       "display_name": "Geological survey",
       "level": 2,
       "score": 0.67110103,
       "qid": null
     },
     {
       "id": "https://openalex.org/c161191863",
       "wikidata": "https://www.wikidata.org/wiki/Q199655",
       "display_name": "Library science",
       "level": 1,
       "score": 0.4559657,
       "qid": "Q226257"
     },
     {
       "id": "https://openalex.org/c86251818",
       "wikidata": "https://www.wikidata.org/wiki/Q816754",
       "display_name": "Benchmarking",
       "level": 2,
       "score": 0.45031193,
       "qid": null
     },
     {
       "id": "https://openalex.org/c98045186",
       "wikidata": "https://www.wikidata.org/wiki/Q205663",
       "display_name": "Process (computing)",
       "level": 2,
       "score": 0.43113342,
       "qid": null
     },
     {
       "id": "https://openalex.org/c2778139618",
       "wikidata": "https://www.wikidata.org/wiki/Q13440398",
       "display_name": "Workforce",
       "level": 2,
       "score": 0.42387113,
       "qid": null
     },
     {
       "id": "https://openalex.org/c17744445",
       "wikidata": "https://www.wikidata.org/wiki/Q36442",
       "display_name": "Political science",
       "level": 0,
       "score": 0.3067996,
       "qid": "Q226183"
     },
     {
       "id": "https://openalex.org/c41008148",
       "wikidata": "https://www.wikidata.org/wiki/Q21198",
       "display_name": "Computer science",
       "level": 0,
       "score": 0.2746944,
       "qid": "Q158969"
     },
     {
       "id": "https://openalex.org/c187736073",
       "wikidata": "https://www.wikidata.org/wiki/Q2920921",
       "display_name": "Management",
       "level": 1,
       "score": 0.2212779,
       "qid": "Q169154"
     },
     {
       "id": "https://openalex.org/c127313418",
       "wikidata": "https://www.wikidata.org/wiki/Q1069",
       "display_name": "Geology",
       "level": 0,
       "score": 0.11740789,
       "qid": "Q158984"
     },
     {
       "id": "https://openalex.org/c151730666",
       "wikidata": "https://www.wikidata.org/wiki/Q7205",
       "display_name": "Paleontology",
       "level": 1,
       "score": 0.0,
       "qid": "Q159017"
     },
     {
       "id": "https://openalex.org/c199539241",
       "wikidata": "https://www.wikidata.org/wiki/Q7748",
       "display_name": "Law",
       "level": 1,
       "score": 0.0,
       "qid": "Q166219"
     },
     {
       "id": "https://openalex.org/c162324750",
       "wikidata": "https://www.wikidata.org/wiki/Q8134",
       "display_name": "Economics",
       "level": 0,
       "score": 0.0,
       "qid": "Q166161"
     },
     {
       "id": "https://openalex.org/c111919701",
       "wikidata": "https://www.wikidata.org/wiki/Q9135",
       "display_name": "Operating system",
       "level": 1,
       "score": 0.0,
       "qid": "Q226285"
     }
   ],
   "corresponding_author_ids": [],
   "corresponding_institution_ids": [],
   "countries_distinct_count": 0,
   "counts_by_year": [],
   "created_date": "2022-05-12",
   "datasets": [],
   "display_name": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
   "doi": "https://doi.org/10.3133/ofr20211035",
   "fulltext_origin": "pdf",
   "fwci": 0.0,
   "grants": [],
   "has_fulltext": true,
   "id": "https://openalex.org/W4237331165",
   "ids": {
     "openalex": "https://openalex.org/W4237331165",
     "doi": "https://doi.org/10.3133/ofr20211035"
   },
   "indexed_in": [
     "crossref"
   ],
   "institutions_distinct_count": 0,
   "is_paratext": false,
   "is_retracted": false,
   "keywords": [
     {
       "id": "https://openalex.org/keywords/geological-survey",
       "display_name": "Geological survey",
       "score": 0.67110103
     },
     {
       "id": "https://openalex.org/keywords/research-data",
       "display_name": "Research Data",
       "score": 0.48242
     },
     {
       "id": "https://openalex.org/keywords/benchmarking",
       "display_name": "Benchmarking",
       "score": 0.45031193
     }
   ],
   "language": "en",
   "locations": [
     {
       "is_oa": true,
       "landing_page_url": "https://doi.org/10.3133/ofr20211035",
       "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
       "source": {
         "id": "https://openalex.org/S4210194219",
         "display_name": "Antarctica A Keystone in a Changing World",
         "issn_l": "0196-1497",
         "issn": [
           "0196-1497",
           "2331-1258",
           "2332-4899"
         ],
         "is_oa": true,
         "is_in_doaj": false,
         "is_core": true,
         "host_organization": "https://openalex.org/P4310316088",
         "host_organization_name": "United States Department of the Interior",
         "host_organization_lineage": [
           "https://openalex.org/P4310316088"
         ],
         "host_organization_lineage_names": [
           "United States Department of the Interior"
         ],
         "type": "journal"
       },
       "license": null,
       "license_id": null,
       "version": "publishedVersion",
       "is_accepted": true,
       "is_published": true
     }
   ],
   "locations_count": 1,
   "mesh": [],
   "ngrams_url": "https://api.openalex.org/works/W4237331165/ngrams",
   "open_access": {
     "is_oa": true,
     "oa_status": "gold",
     "oa_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
     "any_repository_has_fulltext": false
   },
   "primary_location": {
     "is_oa": true,
     "landing_page_url": "https://doi.org/10.3133/ofr20211035",
     "pdf_url": "https://pubs.usgs.gov/of/2021/1035/ofr20211035.pdf",
     "source": {
       "id": "https://openalex.org/S4210194219",
       "display_name": "Antarctica A Keystone in a Changing World",
       "issn_l": "0196-1497",
       "issn": [
         "0196-1497",
         "2331-1258",
         "2332-4899"
       ],
       "is_oa": true,
       "is_in_doaj": false,
       "is_core": true,
       "host_organization": "https://openalex.org/P4310316088",
       "host_organization_name": "United States Department of the Interior",
       "host_organization_lineage": [
         "https://openalex.org/P4310316088"
       ],
       "host_organization_lineage_names": [
         "United States Department of the Interior"
       ],
       "type": "journal"
     },
     "license": null,
     "license_id": null,
     "version": "publishedVersion",
     "is_accepted": true,
     "is_published": true
   },
   "primary_topic": {
     "id": "https://openalex.org/T11937",
     "display_name": "Data Sharing and Stewardship in Science",
     "score": 0.9668,
     "subfield": {
       "id": "https://openalex.org/subfields/1710",
       "display_name": "Information Systems"
     },
     "field": {
       "id": "https://openalex.org/fields/17",
       "display_name": "Computer Science"
     },
     "domain": {
       "id": "https://openalex.org/domains/3",
       "display_name": "Physical Sciences"
     }
   },
   "publication_date": "2021-01-01",
   "publication_year": 2021,
   "referenced_works": [
     "https://openalex.org/W4241161963"
   ],
   "referenced_works_count": 1,
   "related_works": [
     "https://openalex.org/W4254648744",
     "https://openalex.org/W4254301698",
     "https://openalex.org/W4230658059",
     "https://openalex.org/W2965559317",
     "https://openalex.org/W2554671766",
     "https://openalex.org/W2181044488",
     "https://openalex.org/W2082086861",
     "https://openalex.org/W2068643977",
     "https://openalex.org/W2044563579",
     "https://openalex.org/W2030000021"
   ],
   "sustainable_development_goals": [],
   "title": "Final report on the assessment of the U.S. Geological Survey\u2019s bureauwide Research Grade Evaluation (RGE) process",
   "topics": [
     {
       "id": "https://openalex.org/T11937",
       "display_name": "Data Sharing and Stewardship in Science",
       "score": 0.9668,
       "subfield": {
         "id": "https://openalex.org/subfields/1710",
         "display_name": "Information Systems"
       },
       "field": {
         "id": "https://openalex.org/fields/17",
         "display_name": "Computer Science"
       },
       "domain": {
         "id": "https://openalex.org/domains/3",
         "display_name": "Physical Sciences"
       }
     }
   ],
   "type": "article",
   "type_crossref": "journal-article",
   "updated_date": "2024-08-09T12:48:35.397167",
   "versions": [],
   "qid": "Q56180"
 }

}