Friday 20 October 2023

Tableau server enable incremental extracts

To enable incremental extracts on Tableau Server, you need to:

  1. Configure the data source for incremental extracts.
  2. Publish the data source to Tableau Server.
  3. Create an extract refresh schedule.

Configure the data source for incremental extracts

To configure the data source for incremental extracts, open the data source in Tableau Desktop and select Data > Extract Data.

In the Extract Data dialog box, select Incremental refresh and then select a column in the database that will be used to identify new rows. This column should be a unique identifier for each row in the database.

Publish the data source to Tableau Server

Once you have configured the data source for incremental extracts, you need to publish it to Tableau Server. To do this, select File > Publish Data Source.

In the Publish Data Source dialog box, select the appropriate Tableau Server site and project, and then click Publish.

Create an extract refresh schedule

Once the data source has been published to Tableau Server, you need to create an extract refresh schedule. To do this, navigate to the Data Sources page on Tableau Server and click the More actions menu (three dots) next to the data source that you want to create an extract refresh schedule for.

Select Edit Extract Refresh Schedule.

In the Extract Refresh Schedule dialog box, select the Enable extract refresh checkbox.

You can then configure the extract refresh schedule to run on a regular basis, such as every day or every hour.

Once you have configured the extract refresh schedule, click Save.

That's it! You have now enabled incremental extracts on Tableau Server.

Here are some additional tips for using incremental extracts:

  • Incremental extracts can only be used with data sources that are connected to a relational database.
  • The column that you select for the incremental extract must be a unique identifier for each row in the database.
  • If you are using a live connection to the data source, you need to make sure that the data source is configured to allow incremental extracts.
  • Incremental extracts can improve the performance of Tableau dashboards and workbooks, but they can also increase the amount of disk space required to store the extract.

If you have any questions about using incremental extracts on Tableau Server, please contact Tableau Support.

Maybe these locations are not writable or multiple nodes were started on the same data path

If Elasticsearch is unable to start due to a data path conflict, it is likely that one of the following is true:

  • The data path is not writable. This could be because the directory does not exist, the user running Elasticsearch does not have permission to write to the directory, or the directory is full.
  • Multiple nodes are trying to start with the same data path. This is not allowed, as each node must have its own unique data path.

To resolve this issue, you can try the following:

  • Make sure that the data path exists and that the user running Elasticsearch has permission to write to the directory.
  • Make sure that only one node is trying to start with the given data path.

If you are still having trouble, you can try the following:

  • Delete the data directory and start Elasticsearch. Elasticsearch will create a new data directory with the default settings.
  • Start Elasticsearch with a different data path.

If you are running Elasticsearch in a production environment, it is important to back up your data before making any changes.

Here are some additional tips for troubleshooting data path conflicts:

  • If you are using a cloud-based Elasticsearch service, such as Amazon Elasticsearch Service (AES) or Elasticsearch Service on Google Cloud Platform (GCP), you can usually check the management console for the service to see if there are any errors related to the data path.
  • If you are running Elasticsearch on your own infrastructure, you can check the Elasticsearch logs for any errors related to the data path.
  • You can also try restarting Elasticsearch to see if that resolves the issue.

If you are still having trouble, you can contact Elastic support for assistance.

Elastic search create a new node in a cluster on same machine

To create a new node in an Elasticsearch cluster on the same machine, you can follow these steps:

  1. Create a new directory for the new node.
  2. Copy the elasticsearch.yml file from the existing node to the new directory.
  3. Edit the elasticsearch.yml file in the new directory to configure the new node.
  4. Start Elasticsearch on the new node.

1. Create a new directory for the new node.

For example, you could create a directory called /path/to/elasticsearch-node2.

2. Copy the elasticsearch.yml file from the existing node to the new directory.

The elasticsearch.yml file contains the configuration settings for Elasticsearch. You need to copy this file from the existing node to the new directory so that the new node can be configured to join the existing cluster.

3. Edit the elasticsearch.yml file in the new directory to configure the new node.

In the elasticsearch.yml file, you need to set the following properties:

  • cluster.name: The name of the Elasticsearch cluster.
  • node.name: The name of the new node.
  • path.data: The directory where Elasticsearch will store its data.
  • path.logs: The directory where Elasticsearch will store its logs.

You should also set the discovery.seed_hosts property to the IP address and port of the existing node. For example, if the existing node has the IP address 127.0.0.1 and is running on port 9200, you would set the discovery.seed_hosts property to the following value:

discovery.seed_hosts: ["127.0.0.1:9200"]

4. Start Elasticsearch on the new node.

To start Elasticsearch on the new node, navigate to the directory where you copied the elasticsearch.yml file and run the following command:

elasticsearch

This will start Elasticsearch on the new node and it will automatically join the existing cluster.

Once the new node has joined the cluster, you can verify that it is connected by running the following command:

curl -XGET 'http://localhost:9200/_cat/nodes'

This will return a list of all the nodes in the cluster, including the new node.

Additional tips

  • If you are using a cloud-based Elasticsearch service, such as Amazon Elasticsearch Service (AES) or Elasticsearch Service on Google Cloud Platform (GCP), you can usually add new nodes to your cluster using the management console for the service.
  • If you are adding a new node to a cluster that is running in production, it is a good practice to do so during a maintenance window. This will help to minimize any disruption to your users.
  • Once you have added a new node to your cluster, you should monitor the cluster to ensure that the new node is healthy and that it is performing well.