Content Fetching

The app has several tools for content fetching, from social media and other sources.

Twitter

The app can be used to fetch tweets through the Twitter API. This system works only with V2 ACCESS, not with previous versions of the API.

API Key

Please refer to the Twitter documentation in order to obtain the API Keys (that are necessary to use the Twitter fetcher). Please also be aware of the API limits, which might change depending on Twitter policy.

Search Query

Run

Starts the fetcher and collects the tweets that match the search query. Tweets can be downloaded and subsequently uploaded in the app for the analysis. In case of errors, the fetcher can also be stopped.

Output

A CSV file where the comma is used as separator.


Telpress

Researchers and companies can request access to this news portal directly contacting Telpress International. The company collects online and offline news from all over the world, with a special focus on Italy. Files are downloaded in a format ready for the SBS BI app.


Event Registry

Event Registry is a system that allows real-time collection of content published by global news outlets. The SBS BI app uses the Event Registry APIs to allow the search and dowload of global news. The main parameters are described here:

API Key

Is the API Key available once registered on eventregistry.org. Please be aware of (free) API limitations, which might change depending on Event Registry policy.

Search Query

or using "keywordSearchMode": "exact":

{
 "$query": {
  "$and": [
       {
            "keyword": "((home OR house) AND (energy OR heathing)) OR (radiator)",
            "keywordSearchMode": "exact"
       },

       {
            "dateStart": "2020-11-09",
            "dateEnd": "2021-05-04",
            "lang": "ita"
       }

  	]
  },
 "$filter": {
  "startSourceRankPercentile": 0,
  "endSourceRankPercentile": 100
 }
}

Run

Starts the fetcher and collects the articles that match the search query. Articles can be downloaded and subsequently uploaded in the app for the analysis. In case of errors, the fetcher can also be stopped.

Output

A CSV file where the vertical bar is used as separator.