There is a newer version of this record available.

Software Open Access

Transformers: State-of-the-Art Natural Language Processing

Wolf, Thomas; Debut, Lysandre; Sanh, Victor; Chaumond, Julien; Delangue, Clement; Moi, Anthony; Cistac, Perric; Ma, Clara; Jernite, Yacine; Plu, Julien; Xu, Canwen; Le Scao, Teven; Gugger, Sylvain; Drame, Mariama; Lhoest, Quentin; Rush, Alexander M.


Citation Style Language JSON Export

{
  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.5706403", 
  "title": "Transformers: State-of-the-Art Natural Language Processing", 
  "issued": {
    "date-parts": [
      [
        2020, 
        10, 
        1
      ]
    ]
  }, 
  "abstract": "<ul>\n<li>Fix gradient_checkpointing backward compatibility (#14408) </li>\n<li>[Wav2Vec2] Make sure that gradient checkpointing is only run if needed (#14407) </li>\n<li>Experimenting with adding proper get_config() and from_config() methods (#14361) </li>\n<li>enhance rewrite state_dict missing _metadata (#14348)</li>\n<li>Support for TF &gt;= 2.7 (#14345)</li>\n<li>improve rewrite state_dict missing _metadata (#14276)</li>\n<li>Fix of issue #13327: Wrong weight initialization for TF t5 model (#14241)</li>\n</ul>", 
  "author": [
    {
      "family": "Wolf, Thomas"
    }, 
    {
      "family": "Debut, Lysandre"
    }, 
    {
      "family": "Sanh, Victor"
    }, 
    {
      "family": "Chaumond, Julien"
    }, 
    {
      "family": "Delangue, Clement"
    }, 
    {
      "family": "Moi, Anthony"
    }, 
    {
      "family": "Cistac, Perric"
    }, 
    {
      "family": "Ma, Clara"
    }, 
    {
      "family": "Jernite, Yacine"
    }, 
    {
      "family": "Plu, Julien"
    }, 
    {
      "family": "Xu, Canwen"
    }, 
    {
      "family": "Le Scao, Teven"
    }, 
    {
      "family": "Gugger, Sylvain"
    }, 
    {
      "family": "Drame, Mariama"
    }, 
    {
      "family": "Lhoest, Quentin"
    }, 
    {
      "family": "Rush, Alexander M."
    }
  ], 
  "note": "If you use this software, please cite it using these metadata.", 
  "version": "v4.12.4", 
  "type": "article", 
  "id": "5706403"
}
36,960
1,291
views
downloads
All versions This version
Views 36,960192
Downloads 1,2919
Data volume 10.0 GB110.5 MB
Unique views 30,732141
Unique downloads 6659

Share

Cite as