---
title: "Introduction to Engineering Data"
slug: "introduction-to-engineering-data"
updated: 2023-12-15T21:02:31Z
published: 2023-12-15T21:02:31Z
canonical: "docs.datajet.app/introduction-to-engineering-data"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://docs.datajet.app/llms.txt
> Use this file to discover all available pages before exploring further.

# Introduction to Engineering Data

What is Engineering Data?Data engineering is the process of transforming data. It involves creating and maintaining processes to make data usable for analysis and decision-making.

There are multiple approaches for engineering - or transforming - data in DataJet. These can be broadly grouped as:

1. [Scripting](/v1/docs/introduction-to-scripting)
2. Using [DataJet Dektop](/v1/docs/introduction-to-datajet-desktop)

However, it should be noted that the two groups are not exclusive of each other - engineering that is done via the User Interface is automatically recorded in the [project history](/v1/docs/import-definitions), and User Interface data objects - such as (transformed) tables and fields - can be added to scripts via drag and drop.

With that in mind, the following workflows are all possible depending on the project approach and purpose:

![](https://cdn.document360.io/73b6469b-c1e4-47e9-aa65-986c8ebd17ca/Images/Documentation/image-1674201227591.png) These workflows can be grouped into 5 stages:

1. Importing Data
2. Inspecting, Analysing and Engineering Fields
3. Turning insight into repeatable actions
4. Testing and Refining repeatable engineering actions
5. Automated engineering

The most common workflow is a mix of Interactive UI and Scripting.

## Importing Data

For details on how to get started with Importing Data, see [Creating a Project and Uploading Data](/v1/docs/creating-a-project-and-uploading-data) or for more information see [Introduction to Loading Data](/v1/docs/introduction-to-loading-data).

## Inspecting, Analysing and Engineering Fields

### Inspecting and Analysing Fields

Before engineering a field, it is often necessary to inspect it. DataJet offers many different routes to inspection, including:

- [Data View](/v1/docs/dataset-scratch)
- [Data Audit](/v1/docs/data-audit)
- [Context Panel](/v1/docs/context-panel-getting-started)
- [Profiling](/v1/docs/profile)
- [Modelling](/v1/docs/model-processing-quick-reference)
- [Statistics](/v1/docs/statistics-quick-reference)
- [Field Analyzer](/v1/docs/field-analyzer-introduction)

### Engineering Fields

The following broad functional groups are available for engineering fields via the User Interface Menu options:

- [Decodes](/v1/docs/decode-field-custom)
- [Banded Fields](/v1/docs/banded-fields-custom)
- [Functions](/v1/docs/general-functions)
- [Expressions](/v1/docs/expression-field)
- [User Defined Fields](/v1/docs/programmed-field)
- [Aggregations](/v1/docs/aggregate)

Often it is necessary to design and create a Data Model/Schema. The following functional areas support this activity:

- [Joins](/v1/docs/joins)
- [Key Tables](/v1/docs/make-key-table)
- Time Series Tables
- Data Model Scripting Methods

### Turning Insight into repeatable actions

- [Script Editor](/v1/docs/script-editor)
- [Scripting Methods](/v1/docs/scriptingmethod)
- [Project History and Import Definitions](/v1/docs/import-definitions)

### Testing and refining repeatable actions

- Controlling Scripts
- Techniques for efficient script development

### Automated Engineering

- Scheduling Load and Engineering
- Triggers
- Notifications
- Data Audits