Published April 24, 2023 | Version 3.0.0
Software Open

gwu-libraries/sfm-twitter-harvester: Version 3.0.0

Authors/Creators

  • 1. George Washington University Libraries
  • 2. Stanford University Libraries
  • 3. @gwu-libraries
  • 4. The George Washington University
  • 5. @googlers

Description

Support for Twitter API v.2

See also sfm-ui

  • Added support (with twarc2) for harvesting from search, academic search, user timeline, and filtered stream endpoints
  • Search and academic search harvests allow for harvesting Tweets by specific date ranges.
  • Search and academic search allow for limiting harvests to a specific number of Tweets (useful vis-a-vis new monthly caps per Twitter app/credential)
  • Implemented stream harvesting, including support for adding and deleting multiple streaming rules
  • Incorporated twarc-csv for handling CSV and Excel exports from Twitter v.2 data
  • Unit tests written for v.2 harvester and exporter
  • Implemented user-friendly error handling for v.2 endpoints

Files

gwu-libraries/sfm-twitter-harvester-3.0.0.zip

Files (701.8 kB)

Name Size Download all
md5:340f5b73749c95d6d7bf0c55c5beab0e
701.8 kB Preview Download

Additional details

Related works

Is supplement to
https://github.com/gwu-libraries/sfm-twitter-harvester/tree/3.0.0 (URL)