Statistics API

Kindly
Get started
Search…
Introduction
Ticket webhooks (BETA)
Statistics API
Rationale
We have created a separate service for statistics about your Kindly chatbots. This service is named Sage and lives at sage.kindly.ai. The statistics you can view in the Kindly platform are provided by Sage. The same API that the platform uses is available for you to collect statistics for your own purposes.
Sage has it's own database which contains only non-personal data. When end users chat with chatbots their messages are stored and processed in Kindly's database, and these can be manually or automatically deleted after some time to protect the end user's privacy. The data in Sage's database will not be deleted, but this data doesn't contain the user's message or any personal metadata, only an indication that someone messaged the bot at some specific time. This way we can keep aggregated statistics such as the number of chats per day, while also allowing the end user to have their privacy protected.
Authentication
To access Sage's API, you need to obtain a JWT from Kindly. This token is signed by Kindly and Sage checks the signature to decide whether to allow or deny your API request. Use this token as your authorization header in your API requests. The tokens have short lifetimes, so you can only use the token for a short while before you need to obtain another one.
Obtaining a JWT programmatically
Sage auth sequence diagram
If you have the required permissions, you can create a permanent API key in the platform. This long-lived key can be used by a programmatic service you create to obtain short-lived JWTs which can then be used for statistics requests.
Send API key to api.kindly.ai to receive JWT:
1
curl --request GET \
2
  --url 'https://api.kindly.ai/api/v2/bot/<BOT_ID>/sage/auth' \
3
  --header 'authorization: Bearer <API_KEY>'
Copied!
Send a request to sage.kindly.ai to test your new token
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/sessions/messages?from=2019-01-01&to=2019-02-01' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
About timezones
​List of tz database time zones​
All time values in the database are stored as UTC. If you want results in your local timezone, which takes into consideration daylight saving time and other irregularities, you can provide a tz argument to your API request with the tzdb name of the timezone you want:
GET https://sage.kindly.ai/api/...&tz=Europe/Oslo
⚠ Timezone gotchas
The timezone parameter is important to consider if you are making a request where the data is aggregated by day. If someone messages the bot at 9 p.m. (summer time) on Monday in California, this is stored in the database as occurring at 4 a.m. on Tuesday. To get the API results scoped for California time, you would send a request with tz=America/Los_Angeles.
About granularity
Some aggregations can use a granularity parameter, for example the aggregation that counts the number of messages per hour, day or week. You can specify this with granularity=hour, etc. These default to granularity=day if not otherwise specified. Note that hour granularity is only allowed if the time between from and to is one week or less.
About sources and languages
The events that are aggregated by Sage are labeled by which source and language the user and bot were chatting with. Your API requests can be filtered by these values. Not adding any filters to your request will include all data in the results, unfiltered.
Sources
Sources are the different locations where your bot may be deployed. For example:
test is source value for conversations by bot builders within the Kindly platform.
web is the source value for Kindly Chat deployed on web sites, excluding the Kindly platform.
app is the source value for chats via the application API.
If you do not filter by sources, all data will be included in the results, including test data. To select only specific sources, you can send one or more filters like this:
GET https://sage.kindly.ai/api/...&sources[]=web&sources[]=app
You can also select sources to exclude, by prefixing with a minus sign. This means that the API will return data from every source except the ones listed. GET https://sage.kindly.ai/api/...&sources[]=-test
Language codes
The language used to chat between the user and the bot is represented by a two-letter language code. If your bot does not use multiple languages, you can safely ignore this parameter.
If you have multiple languages in your bot and you want to filter by language, you can send one or more filters like this:
GET https://sage.kindly.ai/api/...&language_code[]=en&language_code[]=nb
Statistics APIs
Filtering options
Most of the APIs can be filtered by time, language and source. To see what your options are for these filters, you can send a request to the /meta/options API.
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/meta/options' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": {
3
    "first": "2019-04-28T07:22:52.825000",
4
    "last": "2019-09-04T06:48:41.100000",
5
    "language_codes": ["en", "nb"],
6
    "sources": ["app", "test", "web"],
7
    "granularities": ["hour", "day", "week"]
8
  }
9
}
Copied!
Chat sessions
Number of chats where users engaged with the bot
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
granularity (default: day)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/sessions/chats?from=2019-07-01&to=2019-07-07' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "count": 485,
5
      "date": "2019-07-01T00:00:00.000000"
6
    },
7
    {
8
      "count": 434,
9
      "date": "2019-07-02T00:00:00.000000"
10
    },
11
    {
12
      "count": 459,
13
      "date": "2019-07-03T00:00:00.000000"
14
    },
15
    {
16
      "count": 446,
17
      "date": "2019-07-04T00:00:00.000000"
18
    },
19
    {
20
      "count": 355,
21
      "date": "2019-07-05T00:00:00.000000"
22
    },
23
    {
24
      "count": 283,
25
      "date": "2019-07-06T00:00:00.000000"
26
    }
27
  ]
28
}
Copied!
User messages
Number of messages from users
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
granularity (default: day)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/sessions/messages?from=2019-07-01&to=2019-07-07' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "count": 1661,
5
      "date": "2019-07-01T00:00:00.000000"
6
    },
7
    {
8
      "count": 1507,
9
      "date": "2019-07-02T00:00:00.000000"
10
    },
11
    {
12
      "count": 1563,
13
      "date": "2019-07-03T00:00:00.000000"
14
    },
15
    {
16
      "count": 1572,
17
      "date": "2019-07-04T00:00:00.000000"
18
    },
19
    {
20
      "count": 1227,
21
      "date": "2019-07-05T00:00:00.000000"
22
    },
23
    {
24
      "count": 964,
25
      "date": "2019-07-06T00:00:00.000000"
26
    }
27
  ]
28
}
Copied!
Fallback rate time series
Number of and fraction of bot replies that are fallbacks, as an aggregated time series.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
granularity (default: day)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/fallbacks/series?from=2019-07-01&to=2019-07-07' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
count represents the number of fallback messages in the given time interval, rate represents which fraction of the total number of bot replies in the time interval are fallbacks.
1
{
2
  "data": [
3
    {
4
      "count": 177,
5
      "date": "2019-07-01T00:00:00.000000",
6
      "rate": 0.12132805028009291
7
    },
8
    {
9
      "count": 161,
10
      "date": "2019-07-02T00:00:00.000000",
11
      "rate": 0.1207012308839985
12
    },
13
    {
14
      "count": 138,
15
      "date": "2019-07-03T00:00:00.000000",
16
      "rate": 0.09981955972573078
17
    },
18
    {
19
      "count": 149,
20
      "date": "2019-07-04T00:00:00.000000",
21
      "rate": 0.10669992872416251
22
    },
23
    {
24
      "count": 114,
25
      "date": "2019-07-05T00:00:00.000000",
26
      "rate": 0.10400945540503682
27
    },
28
    {
29
      "count": 94,
30
      "date": "2019-07-06T00:00:00.000000",
31
      "rate": 0.10891544117647059
32
    }
33
  ]
34
}
Copied!
Fallback rate total
Number of and fraction of bot replies that are fallbacks, as a total aggregate for the selected time interval.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/fallbacks/total?from=2019-07-01&to=2019-07-07' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
count represents the number of fallback messages in the given time interval, rate represents which fraction of the total number of bot replies in the time interval are fallbacks.
1
{
2
  "data": {
3
    "count": 836,
4
    "rate": 0.11061601724160727
5
  }
6
}
Copied!
Web client / Kindly Chat pages
Lists most frequent web pages where interactions with the bot has happened. Returns top 3 pages by default, use limit parameter to request more results.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
limit (default: 3)
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/chatbubble/pages?from=2019-07-01&to=2019-07-07' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "messages": 1615,
5
      "sessions": 465,
6
      "web_host": "www.example.com",
7
      "web_path": "/"
8
    },
9
    {
10
      "messages": 1512,
11
      "sessions": 428,
12
      "web_host": "www.example.no",
13
      "web_path": "/"
14
    },
15
    {
16
      "messages": 784,
17
      "sessions": 264,
18
      "web_host": "www.example.com",
19
      "web_path": "/page"
20
    }
21
  ]
22
}
Copied!
Number of handovers, time series
The number of handover requests (while open), requests while closed, started handovers and ended handovers in the requested time period, as a time series.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
granularity (default: day)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/takeovers/series?from=2019-09-16&to=2019-09-23' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "date": "2019-09-16T00:00:00.000000",
5
      "ended": 40,
6
      "requests": 58,
7
      "requests_while_closed": 0,
8
      "started": 44
9
    },
10
    {
11
      "date": "2019-09-17T00:00:00.000000",
12
      "ended": 27,
13
      "requests": 40,
14
      "requests_while_closed": 0,
15
      "started": 28
16
    },
17
    {
18
      "date": "2019-09-18T00:00:00.000000",
19
      "ended": 35,
20
      "requests": 44,
21
      "requests_while_closed": 0,
22
      "started": 35
23
    },
24
    {
25
      "date": "2019-09-19T00:00:00.000000",
26
      "ended": 55,
27
      "requests": 88,
28
      "requests_while_closed": 0,
29
      "started": 55
30
    },
31
    {
32
      "date": "2019-09-20T00:00:00.000000",
33
      "ended": 64,
34
      "requests": 86,
35
      "requests_while_closed": 0,
36
      "started": 65
37
    },
38
    {
39
      "date": "2019-09-21T00:00:00.000000",
40
      "ended": 0,
41
      "requests": 0,
42
      "requests_while_closed": 2,
43
      "started": 0
44
    },
45
    {
46
      "date": "2019-09-22T00:00:00.000000",
47
      "ended": 0,
48
      "requests": 0,
49
      "requests_while_closed": 1,
50
      "started": 0
51
    }
52
  ]
53
}
Copied!
Number of handovers, total
The total number of handover requests (while open), requests while closed, started handovers and ended handovers in the requested time period.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/takeovers/totals?from=2019-09-16&to=2019-09-23' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": {
3
    "ended": 44,
4
    "requests": 79,
5
    "requests_while_closed": 3,
6
    "started": 47
7
  }
8
}
Copied!
Aggregated chatbubble feedback
If you have enabled the feedback feature in Kindly Chat you can get a summary of the ratings given by users in the period. The API considers the ratings as numbers, with 1 being the lowest rating. Both the count of the number of ratings and the ratio out of the total number of ratings is given.
This API only returns aggregated data. If you want to analyze the feedback texts users have given you can get these from an inbox backup. See also: Daily data dump of Inbox to AWS S3 bucket​
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/feedback/summary?from=2019-09-16&to=2019-09-23' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": {
3
    "binary": [
4
      {
5
        "count": 50,
6
        "rating": 1,
7
        "ratio": 0.5
8
      },
9
      {
10
        "count": 50,
11
        "rating": 2,
12
        "ratio": 0.5
13
      }
14
    ],
15
    "emojis": [
16
      {
17
        "count": 0,
18
        "rating": 1,
19
        "ratio": 0.0
20
      },
21
      {
22
        "count": 0,
23
        "rating": 2,
24
        "ratio": 0.0
25
      },
26
      {
27
        "count": 0,
28
        "rating": 3,
29
        "ratio": 0.0
30
      }
31
    ]
32
  }
33
}
Copied!
Button clicks
An ordered list of the buttons most clicked by users chatting with the bot, and the dialogue to which each button belongs. Has both a count of the number of occurrences, and a ratio out of the total amount of button clicks for the period. Returns top 5 results by default, use the limit parameter to request more data.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
limit (default: 5)
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/buttons/most_clicked?from=2019-09-16&to=2019-09-23' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "button_id": "9d09d898-90d5-4ba9-879c-7faa0f3ec629",
5
      "button_type": "quick_reply",
6
      "count": 46,
7
      "dialogue_id": "6a6de8f8-724d-4dc3-adcb-0b30373cfb3b",
8
      "ratio": 0.12234042553191489
9
    },
10
    {
11
      "button_id": "6b0c5cc7-d612-4f1e-bfd9-6057130146f3",
12
      "button_type": "dialogue_trigger",
13
      "count": 26,
14
      "dialogue_id": "6a6de8f8-724d-4dc3-adcb-0b30373cfb3b",
15
      "ratio": 0.06914893617021277
16
    },
17
    {
18
      "button_id": "a75a41b7-0132-4c0c-9cf7-82cb500c8af9",
19
      "button_type": "dialogue_trigger",
20
      "count": 23,
21
      "dialogue_id": "6a6de8f8-724d-4dc3-adcb-0b30373cfb3b",
22
      "ratio": 0.061170212765957445
23
    },
24
    {
25
      "button_id": "17b666ac-0276-478b-a626-8659a90a1a25",
26
      "button_type": "quick_reply",
27
      "count": 20,
28
      "dialogue_id": "c4aaf069-a0b0-4eb1-ba65-81f46f8c8ecc",
29
      "ratio": 0.05319148936170213
30
    },
31
    {
32
      "button_id": "4f85b25b-b793-4d20-9479-3c2c5b224ebf",
33
      "button_type": "dialogue_trigger",
34
      "count": 17,
35
      "dialogue_id": "72f96a8f-4aaf-4ac2-bb73-1cbec8f2aa57",
36
      "ratio": 0.04521276595744681
37
    }
38
  ]
39
}
Copied!
Labels
The most frequent labels added to chats. Returns top 5 labels by default, use limit parameter to request more data.
Required parameters
from (YYYY-MM-DD)
to (YYYY-MM-DD)
Optional parameters
tz (default: UTC)
sources[]
language_codes[]
limit (default: 5)
Example request
1
curl --request GET \
2
  --url 'https://sage.kindly.ai/api/v1/stats/bot/<BOT_ID>/chatlabels/added?from=2019-09-16&to=2019-09-23' \
3
  --header 'authorization: Bearer <JWT>'
Copied!
Response
1
{
2
  "data": [
3
    {
4
      "count": 5,
5
      "label_id": "35bf04c0-392d-46a0-a741-4d660134d461",
6
      "label_text": "Some label"
7
    },
8
    {
9
      "count": 2,
10
      "label_id": "50e57dca-9045-46bf-93d4-55de77795444",
11
      "label_text": "Another label"
12
    },
13
    {
14
      "count": 2,
15
      "label_id": "2e08978f-24f0-4207-97c0-8945e19b751e",
16
      "label_text": "Label 3"
17
    }
18
  ]
19
}
Copied!
Code example in python
This example requires Python 3.6 or higher (uses f-strings) and the package requests.
You will need to provide two values yourself, the relevant bot ID and an API key with "read statistics" permissions that you have created at https://app.kindly.ai/bot/BOT_ID/connect/api-keys. The code exchanges the API key for a JWT, uses the JWT to get data about the number of messages per day for the bot's lifetime, then renders the data as a Unicode box-character bar chart.
sage:stats.py
1
from time import sleep
2
from urllib.parse import urljoin
3
​
4
import requests
5
​
6
BOT_ID: int = REPLACE ME
7
KINDLY_STATISTICS_API_KEY: str = REPLACE ME  # get this from https://app.kindly.ai/bot/BOT_ID/connect/api-keys
8
SAGE_API_ROOT = 'https://sage.kindly.ai/api/v1/'
9
​
10
JWT = None
11
​
12
​
13
def get_new_jwt():
14
    url = f'https://api.kindly.ai/api/v2/bot/{BOT_ID}/sage/auth'
15
    response = requests.get(url, headers={'Authorization': f'Bearer {KINDLY_STATISTICS_API_KEY}'})
16
    response.raise_for_status()
17
    return response.json()['jwt']
18
​
19
​
20
def sage_request(endpoint, params=None):
21
    global JWT
22
​
23
    url = urljoin(SAGE_API_ROOT, f"stats/bot/{BOT_ID}/{endpoint.lstrip('/')}")
24
    while True:
25
        if JWT is None:
26
            JWT = get_new_jwt()
27
​
28
        try:
29
            response = requests.get(url, params, headers={'Authorization': f'Bearer {JWT}'})
30
            response.raise_for_status()
31
        except requests.HTTPError as e:
32
            if e.response.status_code == 401:
33
                print('401: fetching new JWT before retrying')
34
                JWT = None
35
                continue
36
​
37
            if e.response.status_code == 429:
38
                wait_time = e.response.headers.get('retry-after', 10)
39
                print(f'429: rate limited: waiting {wait_time}s before retrying')
40
                sleep(wait_time)
41
                continue
42
​
43
            raise
44
​
45
        return response.json()['data']
46
​
47
​
48
options = sage_request('/meta/options')
49
​
50
first = options['first']
51
last = options['last']
52
granularities = options['granularities']
53
language_codes = options['language_codes']
54
sources = options['sources']
55
​
56
print(f"""
57
The earliest date with data is: {first}
58
The latest date with data is: {last}
59
Granularity options are: {granularities}
60
Language options are: {language_codes}
61
Source options are: {sources}
62
""")
63
​
64
messages = sage_request('/sessions/messages', {'from': first, 'to': last})
65
​
66
highest = max(x['count'] for x in messages)
67
if highest == 0:
68
    raise Exception('No data found')
69
​
70
​
71
# make a "sideways bar chart" with Unicode box characters
72
def bar(label, n, scale=1):
73
    width = n // scale
74
    if n == 0:
75
        bar = ''
76
    elif width == 0:
77
        bar = '▍'
78
    else:
79
        bar = '█' * width
80
​
81
    return f"{label}: {bar} {n}"
82
​
83
​
84
LINE_WIDTH = 80
85
c = highest // LINE_WIDTH
86
print(f'Number of messages between {first} and {last}')
87
print(*(bar(x['date'].split('T', 2)[0], x['count'], scale=c) for x in messages), sep='\n')
Copied!
Nudge API
Ticket webhooks (BETA)
Last modified 4mo ago