TzKT is a lightweight Tezos blockchain indexer with an advanced API created by the Baking Bad team with huge support from the Tezos Foundation.
The indexer fetches raw data from the Tezos node, then processes it and stores in the database in such a way as to provide effective access to the blockchain data. For example, getting operations by hash, or getting all operations of the particular account, or getting detailed baking rewards, etc. None of this can be accessed via node RPC, but TzKT indexer makes this data (and much more) available.
- More detailed data. TzKT not only collects blockchain data, but also processes and extends it with unique properties or even entities. For example, TzKT was the first indexer introduced synthetic operation types such as "migration" or "revelation penalty", which fill in the gaps in account history (because this data is missed in the blockchain), and the only indexer that correctly distinguishes smart contracts among all contracts.
- Data quality comes first! You will never see an incorrect account balance, or total rolls, or missed operations, etc. TzKT was built by professionals who know Tezos from A to Z (or, in other words, from TZ to KT 😼).
- Advanced API. TzKT provides a REST-like API, so you don't have to connect to the database directly. In addition to basic data access TzKT API has a lot of cool features such as exporting account statements, calculating historical balances (at any block), injecting metadata and much more. See the API documentation, automatically generated using Swagger (Open API 3 specification).
- Low resource consumption. TzKT is fairly lightweight. The indexer consumes up to 128MB of RAM, and the API up to 256MB-1024MB, depending on the configured cache size.
- No local node needed. TzKT indexer works well even with remote RPC node. By default it uses tezos.giganode.io, the most performant public RPC node in Tezos, which is more than enough for most cases.
- Quick start. Indexer bootstrap takes ~15 minutes by using snapshots publicly available for all supported networks. Of course, you can run full synchronization from scratch as well.
- Validation and diagnostics. TzKT indexer validates all incoming data so you will never get to the wrong chain and will never commit corrupted data. Also, the indexer performs self-diagnostics after each block, which guarantees the correct commiting.
- Flexibility and scalability. There is no requirement to run all TzKT components (database, indexer, API) together and on the same machine. This allows flexible optimization, because you can optimize each component separately and according to your needs. Or you can run all the components on the same machine as well, which is much cheaper.
- PostgreSQL. TzKT uses the world's most advanced open source database, that gives a lot of possibilities such as removing unused indexes to reduce storage usage or adding specific indexes to increase performance of specific queries. You can configure replication, clustering, partitioning and much more. You can use a lot of plugins to enable cool features like GraphQL. This is a really powerful database.
- Friendly support. We are always happy to help everyone and are open to discussions and feature requests. Feel free to contact us.
First of all, install git, make, docker, docker-compose, then run the following commands:
git clone https://github.com/baking-bad/tzkt.git
cd tzkt/
make init #run this command just once to init database from the latest snapshot
make start
curl http://127.0.0.1:5000/v1/head
make stopThis is the preferred way, because you have more control over each TzKT component (database, indexer, API). This guide is for Ubuntu 18.04, but if you are using a different OS, the installation process will probably differ only in the "Install packages" step.
sudo apt update
sudo apt install git
wget -q https://packages.microsoft.com/config/ubuntu/18.04/packages-microsoft-prod.deb -O packages-microsoft-prod.deb
sudo dpkg -i packages-microsoft-prod.deb
sudo add-apt-repository universe
sudo apt update
sudo apt install apt-transport-https
sudo apt update
sudo apt -y install dotnet-sdk-3.1
echo "deb http://apt.postgresql.org/pub/repos/apt/ bionic-pgdg main" | sudo tee /etc/apt/sources.list.d/pgdg.list
wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | sudo apt-key add -
sudo apt update
sudo apt -y install postgresql-12 postgresql-client-12
sudo -u postgres psql
postgres=# create database tzkt_db;
postgres=# create user tzkt with encrypted password 'qwerty';
postgres=# grant all privileges on database tzkt_db to tzkt;
postgres=# \q
cd ~
wget "https://tzkt-snapshots.s3.eu-central-1.amazonaws.com/tzkt_240.backup" -O tzkt_db.backup// mainnet restoring takes ~10 min
sudo -u postgres pg_restore -c --if-exists -v -d tzkt_db -1 tzkt_db.backupcd ~
git clone https://github.com/baking-bad/tzkt.git
cd ~/tzkt/Tzkt.Sync/
dotnet publish -o ~/tzkt-sync
Edit configuration file ~/tzkt-sync/appsettings.json with your favorite text editor. What you need is to specify Diagnostics (just disable it), TezosNode.ChainId, TezosNode.Endpoint and ConnectionStrings.DefaultConnection.
Like this:
{
"Protocols": {
"Diagnostics": false,
"Validation": true
},
"TezosNode": {
"ChainId": "NetXdQprcVkpaWU",
"Endpoint": "https://mainnet-tezos.giganode.io/",
"Timeout": 60
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=tzkt_db;username=tzkt;password=qwerty;"
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
}
}cd ~/tzkt-sync
dotnet Tzkt.Sync.dll
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/tzkt-sync
// warn: Tzkt.Sync.Services.Observer[0]
// Observer is started
// info: Tzkt.Sync.Services.Observer[0]
// Applied 776913
// info: Tzkt.Sync.Services.Observer[0]
// Applied 776914
// ....That's it. If you want to run the indexer as a daemon, take a look at this guide: https://docs.microsoft.com/aspnet/core/host-and-deploy/linux-nginx?view=aspnetcore-3.1#create-the-service-file.
Suppose you have already created database tzkt_db, database user tzkt and cloned Tzkt repo to ~/tzkt.
cd ~/tzkt/Tzkt.Api/
dotnet publish -o ~/tzkt-api
Edit configuration file ~/tzkt-api/appsettings.json with your favorite text editor. What you need is to specify ConnectionStrings.DefaultConnection, a connection string for the database created above.
Like this:
{
"Sync": {
"CheckInterval": 20,
"UpdateInterval": 10
},
"Metadata": {
"AccountsPath": "*"
},
"Cache": {
"LoadRate": 0.75,
"MaxAccounts": 32000
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=tzkt_db;username=tzkt;password=qwerty;"
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
},
"AllowedHosts": "*"
}cd ~/tzkt-api
dotnet Tzkt.Api.dll
// info: Tzkt.Api.Services.Metadata.AccountMetadataService[0]
// Accounts metadata not found
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Sync worker initialized with level 776917 and blocks time 60s
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Syncronization started
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: http://localhost:5000
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: https://localhost:5001
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/tzkt-api
// ....That's it. By default API is available on ports 5000 (HTTP) and 5001 (HTTPS). If you want to use HTTPS, you also need to configure certificates. If you want to run API on a different port, add the "Kestrel" section to the appsettings.json (see example below).
In general the steps are the same as for the mainnet, you just need to use different database, different snapshot and different appsettings (chain id and RPC endpoint). Anyway, let's do it from scratch.
sudo -u postgres psql
postgres=# create database cartha_tzkt_db;
postgres=# create user tzkt with encrypted password 'qwerty';
postgres=# grant all privileges on database cartha_tzkt_db to tzkt;
postgres=# \q
cd ~
wget "https://tzkt-snapshots.s3.eu-central-1.amazonaws.com/cartha_tzkt_226.backup" -O cartha_tzkt_db.backup// carthagenet restoring takes ~1 min
sudo -u postgres pg_restore -c --if-exists -v -d cartha_tzkt_db -1 cartha_tzkt_db.backupcd ~
git clone https://github.com/baking-bad/tzkt.git
cd ~/tzkt/Tzkt.Sync/
dotnet publish -o ~/cartha-tzkt-sync
Edit configuration file ~/cartha-tzkt-sync/appsettings.json with your favorite text editor. What you need is to specify Diagnostics (just disable it), TezosNode.ChainId, TezosNode.Endpoint and ConnectionStrings.DefaultConnection.
Like this:
{
"Protocols": {
"Diagnostics": false,
"Validation": true
},
"TezosNode": {
"ChainId": "NetXjD3HPJJjmcd",
"Endpoint": "https://rpc.tzkt.io/carthagenet/",
"Timeout": 30
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=cartha_tzkt_db;username=tzkt;password=qwerty;"
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
}
}cd ~/cartha-tzkt-sync
dotnet Tzkt.Sync.dll
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/cartha-tzkt-sync
// warn: Tzkt.Sync.Services.Observer[0]
// Observer is started
// info: Tzkt.Sync.Services.Observer[0]
// Applied 125790
// info: Tzkt.Sync.Services.Observer[0]
// Applied 125791
// ....That's it. If you want to run the indexer as a daemon, take a look at this guide: https://docs.microsoft.com/aspnet/core/host-and-deploy/linux-nginx?view=aspnetcore-3.1#create-the-service-file.
Suppose you have already created database cartha_tzkt_db, database user tzkt and cloned Tzkt repo to ~/tzkt.
cd ~/tzkt/Tzkt.Api/
dotnet publish -o ~/cartha-tzkt-api
Edit configuration file ~/cartha-tzkt-api/appsettings.json with your favorite text editor. What you need is to specify ConnectionStrings.DefaultConnection, a connection string for the database created above.
By default API is available on ports 5000 (HTTP) and 5001 (HTTPS). If you want to use HTTPS, you also need to configure certificates.
If you want to run API on a different port, add the "Kestrel" section to the appsettings.json.
Like this:
{
"Sync": {
"CheckInterval": 20,
"UpdateInterval": 10
},
"Metadata": {
"AccountsPath": "*"
},
"Cache": {
"LoadRate": 0.75,
"MaxAccounts": 32000
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=cartha_tzkt_db;username=tzkt;password=qwerty;"
},
"Kestrel": {
"EndPoints": {
"Http": {
"Url": "http://localhost:5010"
},
"Https": {
"Url": "https://localhost:5011"
}
}
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
},
"AllowedHosts": "*"
}cd ~/cartha-tzkt-api
dotnet Tzkt.Api.dll
// info: Tzkt.Api.Services.Metadata.AccountMetadataService[0]
// Accounts metadata not found
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Sync worker initialized with level 205804 and blocks time 30s
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Syncronization started
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: http://localhost:5020
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: https://localhost:5021
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/cartha-tzkt-api
// ....That's it.
In general the steps are the same as for the mainnet, you just need to use different database, different snapshot and different appsettings (chain id and RPC endpoint). Anyway, let's do it from scratch.
sudo -u postgres psql
postgres=# create database zero_tzkt_db;
postgres=# create user tzkt with encrypted password 'qwerty';
postgres=# grant all privileges on database zero_tzkt_db to tzkt;
postgres=# \q
cd ~
wget "https://tzkt-snapshots.s3.eu-central-1.amazonaws.com/zero_tzkt_9936.backup" -O zero_tzkt_db.backup// zeronet restoring takes ~1 min
sudo -u postgres pg_restore -c --if-exists -v -d zero_tzkt_db -1 zero_tzkt_db.backupcd ~
git clone https://github.com/baking-bad/tzkt.git
cd ~/tzkt/Tzkt.Sync/
dotnet publish -o ~/zero-tzkt-sync
Edit configuration file ~/zero-tzkt-sync/appsettings.json with your favorite text editor. What you need is to specify Diagnostics (just disable it), TezosNode.ChainId, TezosNode.Endpoint and ConnectionStrings.DefaultConnection.
Like this:
{
"Protocols": {
"Diagnostics": false,
"Validation": true
},
"TezosNode": {
"ChainId": "NetXKakFj1A7ouL",
"Endpoint": "https://rpc.tzkt.io/zeronet/",
"Timeout": 30
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=zero_tzkt_db;username=tzkt;password=qwerty;"
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
}
}cd ~/zero-tzkt-sync
dotnet Tzkt.Sync.dll
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/zero-tzkt-sync
// warn: Tzkt.Sync.Services.Observer[0]
// Observer is started
// info: Tzkt.Sync.Services.Observer[0]
// Applied 125790
// info: Tzkt.Sync.Services.Observer[0]
// Applied 125791
// ....That's it. If you want to run the indexer as a daemon, take a look at this guide: https://docs.microsoft.com/aspnet/core/host-and-deploy/linux-nginx?view=aspnetcore-3.1#create-the-service-file.
Suppose you have already created database zero_tzkt_db, database user tzkt and cloned Tzkt repo to ~/tzkt.
cd ~/tzkt/Tzkt.Api/
dotnet publish -o ~/zero-tzkt-api
Edit configuration file ~/zero-tzkt-api/appsettings.json with your favorite text editor. What you need is to specify ConnectionStrings.DefaultConnection, a connection string for the database created above.
By default API is available on ports 5000 (HTTP) and 5001 (HTTPS). If you want to use HTTPS, you also need to configure certificates.
If you want to run API on a different port, add the "Kestrel" section to the appsettings.json.
Like this:
{
"Sync": {
"CheckInterval": 20,
"UpdateInterval": 10
},
"Metadata": {
"AccountsPath": "*"
},
"Cache": {
"LoadRate": 0.75,
"MaxAccounts": 32000
},
"ConnectionStrings": {
"DefaultConnection": "server=localhost;port=5432;database=zero_tzkt_db;username=tzkt;password=qwerty;"
},
"Kestrel": {
"EndPoints": {
"Http": {
"Url": "http://localhost:5020"
},
"Https": {
"Url": "https://localhost:5021"
}
}
},
"Logging": {
"LogLevel": {
"Default": "Information",
"Microsoft": "Warning",
"Microsoft.Hosting.Lifetime": "Information"
}
},
"AllowedHosts": "*"
}cd ~/zero-tzkt-api
dotnet Tzkt.Api.dll
// info: Tzkt.Api.Services.Metadata.AccountMetadataService[0]
// Accounts metadata not found
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Sync worker initialized with level 205804 and blocks time 30s
// info: Tzkt.Api.Services.Sync.SyncWorker[0]
// Syncronization started
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: http://localhost:5030
// info: Microsoft.Hosting.Lifetime[0]
// Now listening on: https://localhost:5031
// info: Microsoft.Hosting.Lifetime[0]
// Application started. Press Ctrl+C to shut down.
// info: Microsoft.Hosting.Lifetime[0]
// Hosting environment: Production
// info: Microsoft.Hosting.Lifetime[0]
// Content root path: /home/tzkt/zero-tzkt-api
// ....That's it.
Feel free to contact us via:
- Telegram: https://t.me/baking_bad_chat
- Twitter: https://twitter.com/TezosBakingBad
- Email: hello@baking-bad.org
Cheers! 🍺