Data Table (beta)
Overview
Data Table allows users to complete additional steps to their data within the integration process. Users can choose the columns they want to see from this schema. This will then populate a Data Table with each row of data from the stream. The Data Table is available within the Tools section. Data Table features Auto Save, Delete Rows, Add Column, Manage Columns, Check Duplicates, Download CSV, and Download Excel.
Auto Save
The Auto Save Toggle allows users to save each change made to the Data Table. Users must enable the Auto Save feature to save changes with each edit.
Delete Rows
Users simply select the row(s) to be deleted. The Delete Rows button will illuminate from gray to blue when deletion is available. Users can select multiple rows at a time to delete. Please note that deletion is permeant and row data cannot be re-added.
Add Column
Adding a column is simple. Users must click the Add Column button. A screen will open allowing the users to create a specific column. This is useful when users wish to add a column that is not originally within the uploaded data.
Copy Rows
Users will simply select one or multiple cells, click the edit drop-down and select Copy. This allows for quick data changes within the Data Table. This addition allows the Data Table to function similar to Excel or Google Sheets when copying rows of data.
-
Only available when selected cells are adjacent. If attempting to copy nonadjacent cells, notification: "Unsupported Operation: Top copy multiple cells, they must be adjacent to one another".
Paste Rows
Users will simply select one or multiple cells, click the edit drop-down and select paste. This allows for quick data changes within the Data Table. This addition allows the Data Table to function similar to Excel or Google Sheets when pasting rows of data.
-
With a selected cell, you can:
-
Copy the value
-
Paste into the cell
-
Delete the value
-
Start typing to overwrite the value in the cell
-
Press Enter to put your cursor in the text field
-
Ctrl-Click additional cells to select them
-
Shift-Click another cell to select all cells in between
-
Click-Drag to select multiple cells
-
-
Backspace or Delete keypress will clear selected cells
If the column has a foreign key (Reference Data) associated with the pasted value, the autocomplete dropdown will appear. Note that autocomplete options are filtered by the value in the cell. For example, if a cell has the value 'ch' the autocomplete options would only show options that contain 'ch' in the option. If the cell is blank, all autocomplete options appear.
Double click of a cell will put your cursor in the text field. If the field already has a value, the cursor is placed at the end of the text.
Copying & Pasting Rows In DynamoDB/ PostgresSQL
-
These schema types have primary keys, and the primary key fields have special considerations:
-
It is not permitted to modify an existing primary key value. If attempted, notification: "Unsupported Operation: Updating the Primary Key value is not permitted". It is possible to paste into the primary key field if it has no value to begin with.
-
If the value you paste into the primary key field is a duplicate (there is already an existing record with the same primary key value), notification: "Unsupported Operation: Unable to modify the primary key of an existing record, or add a record with a duplicate primary key."
-
-
These schema types only allow loading up to 999 records at a time. When the Data Table initially loads, it will load up to 999 records. If the stream being loaded contains more records, the "Load" button along the bottom of the Data Table will load more records. Therefore, it is possible that the Data Table will only have some of the records loaded. When pasting into the primary key field, it will check if there is an existing record with the same primary key value via a realtime query, which can take a few seconds. While this happens, the Data Table editor is in the 'loading' state and non-interactive.
Type
Array
An Array is a data type that is used when ordering data. Arrays are useful to manage large sets of data under one variable name. This is a common data type.
BigInt
BigInt is a data type that is used when Int values are larger than what is supported for Int. This is an uncommon data type.
Boolean
A Boolean data type is useful for users wishing to utilize True, False, or NULL values.
Char
A Char data type is useful to store a fixed-length amount of data. Char can include letters, numbers, and characters. This is a common data type.
Decimal
A Decimal data type is useful for fixed and precise numbers. This allows for numbers like -10^28-1.
Double
A Double data type is useful when storing 64 bits of decimal numbers or floating points.
Float
A Float data type is useful when using numbers that are not integers. The Float data type is used to store both positive and negative numbers with a decimal point.
Int
An Int data type, or Integer, is useful when using a numerical value. Int does not include a value that with floating point values. This is one of the most common data types.
SmallInt
A SmallInt is a data type that is used when int values are smaller than what is supported for Int. SmallInt values only hold 16 bits. This is an uncommon data type.
String
A String is a data type that is useful for characters, text, numbers, or symbols. This is the most common type of data type.
Struct
A Struct is a data type that is useful for small data structures that require value semantics.
TinyInt
A TinyInt is similar to a SmallInt. TinyInt is a data type that is used when int values are smaller than what is supported for SmallInt. TinyInt values only hold 8 bits/1byte. This is an uncommon data type.
VarChar
A VarChar data type is useful to store a variable length of data. VarChar is like the Char data type. VarChar can include letters, numbers, and characters. This is a common data type.
Manage Columns
Users must click the Manage Columns button. A screen will open to manage columns. Within the Manage Columns section users can reorder columns and delete columns. To reorder the columns, click the 6 dots next to the field and drag to the desired location. To delete the column, click the box next to the column and click the red illuminated Delete Button. Please note that Deleting columns are a permeant change.
Check Duplicates
The Check Duplicates button is useful to check for duplicated data. Clicking the three dots next to the Check Duplicates button will open additional check duplicate options. The current duplicate options include ignore case, ignore whitespace and select duplicates (except first). Selecting both options are encouraged to complete a more thorough check duplicate search. You can also check for duplicates by specific columns, by checking or unchecking columns in the list.
Upload
Click to open a file from your local machine or drag and drop a file to upload. File will be uploaded to the desired schema.
Choose the file type which follow the same steps as the File Upload section of DataBlend
Download CSV
The Download CSV button will allow users to download the updated schema. Schema downloads are limited to 10MB.
Download Excel
The Download Excel button will allow users to download the updated schema.