Skip to content

Commit 464483f

Browse files
authored
video added
1 parent 24079ea commit 464483f

1 file changed

Lines changed: 29 additions & 27 deletions

File tree

AzurePortal/1_MedallionArch/README.md

Lines changed: 29 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -123,37 +123,39 @@ https://github.com/user-attachments/assets/fdb64dd2-a6ec-4da0-a385-e55f875c8f8e
123123

124124
https://github.com/user-attachments/assets/56308a58-cf72-4f0f-bf3e-e9e1669fa0df
125125

126-
2. **Create Dataflows or Pipelines**: Use Data Factory to create dataflows or pipelines that ingest data into the Bronze lakehouse.
127-
- In Data Factory, create a new pipeline.
128-
- Add activities to the pipeline to ingest data from the identified sources.
129126

130-
> Image you want to extract data from your `sql database`
131-
132-
<img width="550" alt="image" src="https://github.com/user-attachments/assets/1b186362-8041-4bd7-b797-ea2061d80b63">
127+
> Image you want to extract data from your `sql database`
133128
134-
> Sample table:
135-
136-
```sql
137-
CREATE TABLE dbo.Employees (
138-
EmployeeID INT PRIMARY KEY,
139-
FirstName VARCHAR(50),
140-
LastName VARCHAR(50),
141-
BirthDate DATE,
142-
HireDate DATE,
143-
JobTitle VARCHAR(50),
144-
Salary DECIMAL(10, 4)
145-
);
146-
147-
INSERT INTO dbo.Employees (EmployeeID, FirstName, LastName, BirthDate, HireDate, JobTitle, Salary)
148-
VALUES
149-
(1, 'John', 'Doe', '1985-11-15', '2010-03-10', 'Software Engineer', 75000.0000),
150-
(2, 'Jane', 'Smith', '1990-05-22', '2012-07-18', 'Project Manager', 85000.0000),
151-
(3, 'Emily', 'Jones', '1988-04-17', '2014-06-25', 'Data Analyst', 65000.0000),
152-
(4, 'Michael', 'Brown', '1982-06-21', '2008-09-15', 'HR Specialist', 55000.0000),
153-
(5, 'Sarah', 'Davis', '1995-09-30', '2020-11-20', 'Marketing Specialist', 60000.0000);
154-
```
129+
<img width="550" alt="image" src="https://github.com/user-attachments/assets/1b186362-8041-4bd7-b797-ea2061d80b63">
155130

131+
> [!NOTE]
132+
> In case you don't have any data at the moment, please follow this video to create a sample:
133+
134+
```sql
135+
CREATE TABLE dbo.Employees (
136+
EmployeeID INT PRIMARY KEY,
137+
FirstName VARCHAR(50),
138+
LastName VARCHAR(50),
139+
BirthDate DATE,
140+
HireDate DATE,
141+
JobTitle VARCHAR(50),
142+
Salary DECIMAL(10, 4)
143+
);
144+
145+
INSERT INTO dbo.Employees (EmployeeID, FirstName, LastName, BirthDate, HireDate, JobTitle, Salary)
146+
VALUES
147+
(1, 'John', 'Doe', '1985-11-15', '2010-03-10', 'Software Engineer', 75000.0000),
148+
(2, 'Jane', 'Smith', '1990-05-22', '2012-07-18', 'Project Manager', 85000.0000),
149+
(3, 'Emily', 'Jones', '1988-04-17', '2014-06-25', 'Data Analyst', 65000.0000),
150+
(4, 'Michael', 'Brown', '1982-06-21', '2008-09-15', 'HR Specialist', 55000.0000),
151+
(5, 'Sarah', 'Davis', '1995-09-30', '2020-11-20', 'Marketing Specialist', 60000.0000);
152+
```
153+
154+
https://github.com/user-attachments/assets/357184bf-cc49-4311-84d4-6369514b3366
156155

156+
2. **Create Dataflows or Pipelines**: Use Data Factory to create dataflows or pipelines that ingest data into the Bronze lakehouse.
157+
- In Data Factory, create a new pipeline.
158+
- Add activities to the pipeline to ingest data from the identified sources.
157159
- **Configure Data Ingestion**: Set up the data ingestion process to load data into the Bronze layer in its raw format.
158160
- Configure the source and destination settings in the pipeline activities.
159161
- Ensure the data is being ingested into the `raw_Bronze` lakehouse.

0 commit comments

Comments
 (0)