Create an index

Index in Elasticsearch is much like a table of a database. Let's list all the indexes of our instance:

curl -XGET "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/_cat/indices?v"

We can see in the following output that we don't have any index as of now.:

health    status    index    uuid                     pri    rep    docs.count    docs.deleted    store.size    pri.store.size

To create an index name demo using curl:

curl -XPUT "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo?pretty&pretty"

If we are using the Console, we just need to change the verb from the drop down to PUT and enter index name demo and press enter. In both case, we should see the following message on successful index creation:

{
  "acknowledged" : true,
  "shards_acknowledged" : true,
  "index" : "demo"
}

Let's list all the indexes using the same previous command:

curl -XGET "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/_cat/indices?v"

We can see in the following output that we have created an index named demo:

health    status    index    uuid                     pri    rep    docs.count    docs.deleted    store.size    pri.store.size
green     open      demo     wHOxKkbhTxSd1eVG7MWhdw   1      1      0             0               460b          230b

Update Mapping

Mapping defines how the data will be stored on that table. Let's check the mapping of our index:

curl -XGET "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/_mapping?pretty&pretty"

We can see from the following output that mapping for our index is not defined.:

{
  "demo": {
    "mappings": {}
  }
}

Let's update he mapping our index:

curl -XPUT "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/_mapping/v1" -H 'Content-Type: application/json' -d'
{
    "v1": {
      "properties": {
        "name":     { "type": "text"  },
        "age":      { "type": "integer" }
      }
    }
}'

For the Console just put /demo/_mapping/v1 on the URL input box paste the following in the box bellow and then press enter:

{
    "v1": {
      "properties": {
        "name":     { "type": "text"  },
        "age":      { "type": "integer" }
      }
    }
}

In both case we should see the following message:

{
  "acknowledged": true
}

Checking the mapping using the same curl command now shows:

{
    "demo": {
        "mappings": {
            "v1": {
                "properties": {
                    "age": {
                        "type": "integer"
                    },
                    "name": {
                        "type": "text"
                    }
                }
            }
        }
    }
}

So it seems we have updated our mapping!!!

Uploading Data

We have defined how to store the data. Now let's upload some:

curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1?pretty&pretty" -H 'Content-Type: application/json' -d' { "name": "user1", "age": 10 }'
curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1?pretty&pretty" -H 'Content-Type: application/json' -d' { "name": "user2", "age": 20 }'
curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1?pretty&pretty" -H 'Content-Type: application/json' -d' { "name": "user3", "age": 30 }'
curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1?pretty&pretty" -H 'Content-Type: application/json' -d' { "name": "user4", "age": 40 }'
curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1?pretty&pretty" -H 'Content-Type: application/json' -d' { "name": "user5", "age": 50 }'

For all successful data upload we should see output similar to this:

{
  "_index" : "demo",
  "_type" : "v1",
  "_id" : "yZJVfGkBdm4qJtidx0HD",
  "_version" : 1,
  "result" : "created",
  "_shards" : {
    "total" : 2,
    "successful" : 2,
    "failed" : 0
  },
  "_seq_no" : 0,
  "_primary_term" : 1
}

Searching Data

Elasticsearch as the name says is used for searching. So let's search the index for user2:

curl -XGET "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/_search?q=name:user2&pretty&pretty"

We should see this result like this:

{
    "took": 0,
    "timed_out": false,
    "_shards": {
        "total": 1,
        "successful": 1,
        "skipped": 0,
        "failed": 0
    },
    "hits": {
        "total": 1,
        "max_score": 1.3862944,
        "hits": [
            {
                "_index": "demo",
                "_type": "v1",
                "_id": "pnBWfGkBLqG7BIrR8Z0d",
                "_score": 1.3862944,
                "_source": {
                    "name": "user2",
                    "age": 20
                }
            }
        ]
    }
}

Update

We can update the data stored in the index as well. We will update the age of user2 using two method but for use to update the age of we need to know the _id of the document. We can use our previous result from search and can see that the _id is pnBWfGkBLqG7BIrR8Z0d. Let's use it to update the age.

1. Fix value. Update a field with a fixed value.:

   curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1/pnBWfGkBLqG7BIrR8Z0d/_update" -H 'Content-Type: application/json' -d' { "doc": { "age": 21 } }'

2. Scripted updates. Update a filed with a scripts, in this case the current value of age field and update with 1.:

   curl -XPOST "https://isdrWzc7nq:3MuCsPLpNRU9ofgA4GY@demo-for-blog-6448511871.eu-central-1.bonsaisearch.net/demo/v1/pnBWfGkBLqG7BIrR8Z0d/_update?pretty&pretty" -H 'Content-Type: application/json' -d' { "script" : "ctx._source.age += 1" }'

In both case we should see output like this:

{
  "_index": "demo",
  "_type": "v1",
  "_id": "pnBWfGkBLqG7BIrR8Z0d",
  "_version": 2,
  "result": "updated",
  "_shards": {
    "total": 2,
    "successful": 2,
    "failed": 0
  },
  "_seq_no": 5,
  "_primary_term": 1
}

Bonsai and Python

We can interact very easily with Bonsai using Python. But if we need to use bare bone way we can use Python requests library and use the Access Key and Access Secret as user name and password.:

import requests
bonsai_url = "https://demo-for-blog-6448511871.eu-central-1.bonsaisearch.net"
user_name = "isdrWzc7nq"
password = "3MuCsPLpNRU9ofgA4GY"
index = "demo"
doc_type = "v1"
id = 1
field_names = ["name","age"]
user1 = ["user1",10]
temp_dict = dict(zip(field_names,user1))
post_url = bonsai_url + "/" + index + "/" + doc_type + "/" + str(id)
header = {'Content-type': 'application/json', 'Accept': 'text/plain'}
post_response = requests.post(post_url, json=temp_dict, headers=header, auth=(user_name, password))
post_response.status_code #should give 201 if successful
post_response.content #should give something like this: b'{"_index":"demo","_type":"v1","_id":"1","_version":1,"result":"created","_shards":{"total":2,"successful":2,"failed":0},"_seq_no":8,"_primary_term":1}'

Deprovision Cluster

Make sure to deprovision your cluster once you are done.

Source

• Create or update mapping in elasticsearch

• Mapping: Elasticsearch Doc

• Basic Authentication: Python Requests

• Bonsai using Python